Hey, I'm fluent in Japanese, I've been in the country for 17 years now and stutter when speaking it. Perhaps not as bad as I do in English but it sucks all the same. It didn't happen until I became fluent in the language. There's little you can do. I wouldn't give up on learning the language because of your stutter though. That would be such a waste.