I usually tend to let it slide, but if it's a person I know a bit better or am around often, I gently let them know that they are not speech disabled like I am. Sure, everyone stutters sometimes, but its not the same. A hyperbolic comparison would be telling a person in a wheelchair, that I also sometimes pull a hamstring and can't walk