Because stutterers have a speech system with a lower capacity than fluent speakers. When you speak alone there is no demand placed on that system, thus you dont meet your stutter threshold.