For me it really differs who is mocking me. When my friends make a subtile joke, I can live with it, mostly because all of us have quirks and it is not ment to hurt anyone but actually relevant to the conversation (puns about a friend being short for example). With my mom on the other hand, being a narcissist and mocking me for it as long as I can remember, she really often tells me it's just "not worth her time to listen like this", that does definitely hurt and makes me very sad. So to me it's mostly in what way it is used, in an argument I would think it would also depend on how heated the argument was, people say stupid stuff when they are angry (I know I have), which they usually regret, maybe try to talk with him about it, and if you can see he is sorry and he means it, he at least would have developed more of an understanding of how much it hurts to you.