That's pretty normal for a lot of people that stutter. Something about a difference in activation in the brain when you speak to yourself, kinda like singing or reading in unison. I also don't stutter when I speak to myself. There's also the fact that anxiety can exacerbate stuttering.