Stuttering is rare, so it’s understandable that they are surprised; but treating you differently is inappropriate. Maybe a response like, “there’s nothing wrong with me; I stutter.”