I have never been ostracized because of my stutter. Pity/odd comments/etc aplenty but never have I been told "we don't want to hang out because you talk funny". Usually it's "we don't want to hang out because you keep stealing our fruit gushers during lunch"