Yes, it matters. If you have a small dick, well that's just tough shit. Nothing can be done about it. Maybe science is the answer. When a big dick dude dies, maybe it's possible to have his dick surgically sewn on you in place of yours!
Could work. Figure it out. Get started on the research.