It gives your mind leverage to shame you for being “bad”. We are often more concerned with what our own mind is going to do with an insult from another because of what our own mind is going to do with it. If they called you a tree you wouldn’t care, because you know you’re not a tree. If they call you a stutterer something you likely hate and already beat yourself up about already it leaves a mark.