Mozilla Firefox already running but it isn't?

Does Firefox complain that it's already running when you're trying to start it with a non-administrator user?

Try deleting the %APPDATA%\Mozilla\Firefox\profiles.ini and start Firefox again. It worked well for me.