Be carefull as the reason that is was never removed could be that the appliance has an asbestos flue pipe and even if you do not intend to remove the old appliance most of these appliances had there compartments lined with asbestos so you should not drill into the walls and release asbestos dust. Contact your local authority enviromental dept for free advise.
davegas, February 2009