I have the same fears as you. Every time I had to face social situations with people, I kept a firm thought like 'be brave, no one cares about your stutter if you're nice,' but I never managed to make friends with those people. Because of this, I developed a fear of socializing and showing my stutter. However, there's been a shift in my mindset. Since childhood, I remember there were people I simply couldn't befriend in any way (and when I was a kid, I didn't even care about my stutter). So, I believe that if you're having trouble socializing and making friends, it's probably more about your personality not matching with others than an issue involving your stutter.