Confidence maybe key but why is everyone else able to speak fine whether stressed, afraid etc? The thing is if we didn't fear we will stutter when we speak, we will be more confident. The fear of stuttering, being judged harshly is the heart of the problem for most of us.