I have noticed that in your native language you have developed a mental model that you can offload the word generation and pronunciation to it. So when you dont think about the word you dont stutter. But with a new language you dont have that automatic word generation in your mind, so you have to think of the word. I have noticed when you think of specific words you stutter in them. That is what i have observed.