Meh, it's completely fine. It's far more of a professional hinderance than a dating hinderance. I'd stop focusing so much on you being a male too - stuttering specific challenges are pretty much the same for dating in either sex or in between.