You are talking about the soffit facia, I think...this is a timber board fixed to the rafters and the guttering is fixed to it. Remove the guttering, including brackets and remove the facia - but you'll also have to remove the horizontal soffit to do this. With the facia off, you'll be able to see if the water penetration has done any harm.
John, April 2008