It is because you dont expect to stutter when you are alone, and then your fear of talking does not cause you to stutter. You should practice this «idgaf» attitude you have when talking alone in the outside world to reduce your anxiety for talking, and reduce your stuttering