I used to think this too and didn't have much success until my later twenties. I focused on taking care of myself, hobbies and getting out there. Eventually someone will recognize it and look past a stutter. There will always be people who don't get it and those people aren't for you.