For me what I have noticed is that I my mind sees the accent as an excuse to be incompetent. Having an accent is associated with not knowing the language well (which is completely untrue) and my mind just goes ‘well the accent is doing the incompetence for me already so i don’t have to be embarrassed about stuttering because the accent is way more obvious’