It sounds like the Heating Valve, or Diverter Valve is letting by, you should find the valve in the airing cupboard near to the pump, depending on what make of valve you have dictates whether it ca be repaired or will have to be replaced.
www.elanar.co.uk, May 2009