Frankly it depends, I speak Arabic and French and I stutter in both, it will really depend on the periods and in what situation I am but it is true that I lose my skills in Arabic more quickly, especially when I have to adapt to another dialect. For English I am learning it, when I speak it with a strong Arabic or French accent I already feel more confident.