Faulty diverter valve. When you turn on the taps the valve should close off the heating port going out to the radiators.
If they get hot while the tap is running you will need a new valve or a re-build.
Call a local service company for quotes for both jobs(full valve or repair).
T.H.S, June 2007