/sbin/rmmod usbmouse
in my rc.local.
/etc/rc.local
runs at boot, last thing before you see a prompt.