Hello firtpi,
It's mind over matter...the worst thing you can do is worry about it.
I am thinking its just you being nervous and anxious - it happens to more people than you may think.
Calm down, relax and have a good time during your next encounter.
If you are using an agency, you may want to ask for a girl that has a little more sensitivity to first timers or shy guys.
Have fun.