Some people suck. You can try only explain your situation to them (not everyone understands what stuttering is) and hope they’re more reasonable in the future.