As a German, I have the same phenomenon when speaking English; it’s harder to speak fluently. To keep it brief, I think a foreign language just adds another layer of complexity. In addition to thinking about what you want to express, and as a stutterer HOW to say it, another language now adds translation of the message.