I don’t think he meant any harm by it man. I think it’s just a way of saying “don’t laugh or joke on him about how he talks he can’t help it.”