Personally, I can't stand stubble. During DATY, it feels like someone is rubbing a piece of sandpaper on my vag. No thanks.
If the beard is somewhat grown out and very well maintained, then there's no issue. A lot of conditioner on the beard beforehand makes it softer.