Focus on the positives, not the negatives. You have friends and a good job. Many people who stutter don't even have that. The overwhelming majority of adults who stutter that I've met have a significant other. Which means there are plenty of women who don't care that you stutty. Loneliness sucks for anyone. But you can change it. You're holding yourself back.