My theory is that we are more focused on doing the voice impersonation and not self monitoring our stutter, which heightens anticipatory anxiety and tension in the vocal cords. Just a theory.