Yes you do have to remove the starter from the engine. It's held on with two bolts. Remove the wires before removing the mounting bolts. The new starter drive will come with instructions on how to replace it.
Rick, March 2007
edit
I can answer this question...
changing starter drive on a craftrman 18.5 B&S engine lawn tractor?