I feel like this in one of my two languages. I stutter (or used to stutter) more in one so I avoided it during my teenage years. I think the way to avoid it is to read more and practice speaking. The way I see it, if adults can be conversational in a new language it should be even easier for us.