For some, the hobby gets to a point where it loses its appeal and just isn't fun anymore. It doesn't have to be about ED issues as there are other variables that can be involved.
Sometimes we can just grow wary of all the day to day circumstances that are required to nail down an appointment with someone we want to see. There were times in the past where there were no providers in the Houston area that I had any interest in seeing. None! So in turn...I felt I had to sit back and wait on travelers to pop up, and hopefully it was someone I had an interest in.
It gets to a point to where you may come to a conclusion and say to yourself...
"Fuck this...I'm done."
When I reach that point, I walk away for a year or sometimes longer than that. I never really retire...I just have to give myself a break from all the bullshit and allow the hobby scene to recharge while I'm away. For some...the hobby is like a drug addiction, but once you can learn to kick the habit, it gets easier to cope with.
As of now the hobby is still fun for me...but there will be a time once again to step back into the shadows.
OP...the whole point is, you don't have to throw in the towel and totally give up if you find our little sub-culture fun. Take a step back and look at what it is that makes it difficult for you and take the steps to fix it. Then you can come back at your leisure and hopefully enjoy yourself again.
Good luck.