Not being huge has plenty of advantages. One, you can bang with more vigor. Harder erections. You can be more intimate given that you can go all the way in. You won't get rejected once she's seen your package. Imagine seeing the hottest woman of your type, whatever your goldilocks zone of 'perfect' hotness in a woman is, and you can't fuck her because she thinks your dick is too big.
I really like intimate sex, but if you have a monster, she's likely not going to be into it and just wants you to hurry the fuck up and be done.
Huge dicks I would surmise are a nice novelty, but after those five minutes are up, it could be a steep downhill. I'd also surmise that being a notch or two above average is the ideal, meaning 'big', but just barely on the big side.
Of course, the ladies can tell you better than I can.