Anxiety might still be the core reason of having a stutter. When you stutter alone it (might) be because your stutter is already "wired" into your brain, as in that is the only way you know how to talk: with stuttering. heck, I might even stutter in my own head, when practicing for something I want to say to someone. I'll literally stutter in my own head.