I have seen this on Laptops with TrackPoints. (A small coloured 'nipple' in the middle of the keyboard that is used to control the pointer.) The fix was to leave it alone until it settled down.
If you have TrackPoint on the keyboard I would replace the keyboard. I would try replacing the mouse anyway as they are so cheap.
T, July 2009