People with milder stutters can have severe anxiety about it. Stutter-related anxiety actually does not have a high correlation with severity of the person's stutter. Also, OP has said that his/her stutter is not very severe. There are all kinds of ways to become more comfortable speaking. Jumping into the deep end *can* be one way.