I would be exactly the same. It can be very hard to brush off. I once stuttered on a sobriety check, was worried they thought I was drunk so I told him I had a stutter, he said he didn't even notice (he totally did but bless him!)