I'm not a believer in speech therapy and all that. I think for a lot of people it can be an impediment to acceptance. I have a mild to moderate stutter as well and I've come to love conversation. I definitely felt like you before. Fortunately, work has burned the embarrassment out of me, so I don't feel bad about stuttering anymore. I've found my own rhythm to speaking that works for me. My general behaviour is I try to control the frame and pace of the conversation. Anyone talking to me has to slow down to my speed and play in my field. The truth is, 99.999999999% of the population don't care at all about your speech. It's all in your own head.