Just to be clear, its not just the rubber you prise off, it comes away (unclicks in fact, as it has a couple of lugs) attached to its thin hard plastic under-piece.
I found (good old google!) replacement batteries at
http://www.cellpacksolutions.com/Search_Data_Sheet.asp?ID=KR-600AE/T
Alan, March 2009