Obviously there is a water leak somewhere,first check the PRV pipe which should terminate outside just below the flue.If it`s leaking you need a new PRV.
Signs of rust inside suggest it may be something else,so I suggest getting a Corgi Engeneer in or your installer back to give it a thorough check.
Gasman, August 2008