I think most people are open minded and understand that it is a speech impediment. The occasional offhand remark comes up ("Did you forget your name?"), but I never get flak for stuttering. Their negative thoughts might be that the stuttering is odd, that my face contorts when I stutter, that I make little eye contact, and that my eyes close when I get blocked. However, I don't think they think it matters.