It is the same for me, I tried to mimic a different accent while speaking Arabic, didn't stutter once, but when I speak normally my stutter comes back. It's weird how it happens