I believe it's mostly due to fear of stuttering in front or around people and getting judged. It adds more pressure increasing your nervousness and anxiety. Where there is nervousness and anxiety, stutter thrives.