It seems normal to me and I think you are overthinking about it. My wild guess is that you gotta pay much attentions onto your speaking because you stutter and the neurological processing of your speaking is of low efficacy so that's why you gotta do it.