I think the spectating gaze is always going to have some element of primal gawking. Benign or malicious, the feeling that someone is taking your attention without much of a satisfying reward must lead to discontent. I basically treat everyone the same. I tune out equally good speakers from bad ones, fluent from stutterers although sometimes I do listen much more attentively to those who may not speak English all that well but offer something different. Like those weird lost in translation puns and idioms. Just because you don't like the stuttering sound doesn't mean you hate the person or whatever. A lot of people where I am have that whiny Valley Girl tone and although it drives me insane to hear, I don't degrade them as people.