I had the weird reverse problem. Nobody really cared about my stutter in middle and high school. I was just a nerd that sat at the edge table with the other nerds lol. But in college, when I became more sociable and tried to reach out, that's when people, and especially the women I was interested in, started to distance themselves due to my stutter. It was the first time I was openly mocked for it on multiple occasions. I basically gave up on even trying for a relationship for a decade due to it, and now I'm 32 and only now trying to figure things out in therapy lol. But yeah, I've heard from a lot of people that my experience is abnormal so I think just being open and willing to talk about it makes you stand out and some people might even like it! Good luck, my dude! You deserve to be happy.