It used to happen to me constantly and then at some point with any person I regularly interacted with they would say something to the effect of "you're not mentally slow like I thought you were" lmao I just brush it off when it happens nowadays because I just think I will probably not speak to them again and I don't care what they think of me.