He isn't as horny as David Sel et Poivre. He's just angry! ;)
The Hulk's pants are made of special material, and it has been hinted that Hulk's pants are made out an incredible fabric made of 'unstable molecules'. This fabric contracts and expands along with the shape of its wearer.