That happens to me, too, and I've heard the same from others. I'm assuming that Firefox has more code to load than IE.
Once it's loaded, it seems just as fast to me. I do have compatibility problems, occasionally, with websites. For example, Ticketmaster doesn't seem to like Firefox, at...