It's only my wife who makes comments like that and she says them in a lighthearted way. Now if I stuttered more often and get comments like that all the time, that could bother me a little.