Maybe, maybe not. What if they're laughing about your hair? Try to view stuff like behind the back gossip as just that. I do the same thing, I think 'we' tend to put MUCH more focus on other people's reaction to our stuttering than they actually do. Basically anyone that does this is not your friend, don't see it any differently as a difficult person.