Nope, you're not the only one- I do this fairly often, but when I was in elementary school it got so bad to where my classmates called me "the ummer" because I would frequently use "um" in my sentences to avoid the eventual stutter. Still working on breaking that habit and having a more confident voice.