I have the same feeling. I think my stutter has improved, but back when I was 14-21 or so I barely spoke to strangers because of the fear. As a result I never made the good friends that people make during those years. I also really never got the hang of how socializing works, if that makes sense. Probably because I never got much practice. These days I try but it still feels like I'm ignored more often than not.