Christ I get that all the time. However I’ve found that often just responding you have a stutter makes them apologise profusely. I don’t do it all the time but I always feel much better when I do and often allows me to feel more at ease in the situation after too.