Liam
After you remove the package restart the machine. I tested here using 64 bits ubuntu 12.04 that had the same issue and it is ok now.
For all other users interested in solve this issue:
If you remove the modemmanager package and still have issue please reply on this thread. But make sure you restart your machine after remove the package.
Regards,
Manoel