Are we pandering to prejudice and a few people's worst qualities by trying to change who we are?

Are we pandering to prejudice and a few people's worst qualities by trying to change who we are? Yes, being taunted or discriminated against because of our stutter is unpleasant. But if we alter our speech to please people who taunt or people who are intolerant of difference, aren't we letting the bad guys win? Who has the problem: people who stutter or people who are intolerant of difference? Shouldn't therapy be supplied for those who have a problem with stutterers? And if we pander to these people by doggedly pursuing a stuttering cure, what will we have to next alter about ourselves to please these intolerant people? Voice too high / low / quiet / loud? Too tall, too short? Don't look like everyone else? Don't think like everyone else? It just seems like it's a never-ending process to radically alter who we are simply to please a very small, unpleasant, intolerant minority in our society.