Chella,
It is up to you! Only you can tell if it feels right. If you do and he doesn't want to see you again, that shows he is shallow minded and immature, especially if you both hit it off.
As for your raging hormones, as a woman, you can have any guy you want when you want. Us men are perpetually horny.