I've had that happen to me before too, especially in spur-of-the-moment things with strangers like you said. Just another reminder to not make stuttering your identity! Also like u/randomalt9999 said, not overthinking things will also help (and that might be why you didn't stutter, you just responded to the question without thinking).