I stutter more when I'm speaking my second language, is it just me?

I stutter more when I'm speaking my second language, is it just me? Hi. My first language is Chinese and English is my second language. I noticed that I stutter not very often when I'm speaking Chinese, but when I speak English I stutter much more. Is this very common, or it's just me?