I used to laugh it off and say "something like that", but now I'll say something like "it's a speech impediment actually" (a phrase I can thankfully get out fluently) to which they usually apologize a lot and tend to feel pretty bad after I tell them it's okay and move on, but I do hope it makes them think twice about making a comment like that in the future.