Do you have stutterer's guilt?

Do you have stutterer's guilt? I'm not sure if anyone else experiences this but I feel guilty in avoiding conversations with nice people over the fear of stuttering. I always hope that they don't think I'm avoiding them, but rather avoiding my own embarrassment. I would LOVE to have beautiful, long conversations but my stutter keeps me down to a handful of words before I run off. I also have this weird view on my own stutter. Almost as if I feel bad for others who have to hear it. Am I only? Does anyone else feel bad for avoiding conversations with people?