I've had the same thing happen to me. I've also lost friends because I purposely didn't talk much, in fear of stuttering and how they might view me. I've also made great friends despite my stuttering. Stuttering will put you into to situations where, no matter the outcome, you will view it as a failure, even if no one else does. All you can do is be yourself and learn to accept it.