You don't want to mess with this yourself as it sounds like a stuck gas valve, which means the gas is remaining on after the water differential valve shuts off. This will activate the overheat and shut down the pilot via the thermo-electric valve. My best advise would to turn it off, don't use it and contact a Gas Safe Registered engineer.
Sean, August 2009