Because non-stutters do not care. And a lot of them believe it can be "fixed" by willpower alone because "they sometimes stutter, too." This leads them to believe their experiences are the same we are having and gives them justification to dismiss our struggles.