He probably didn’t notice. If he did I’m sure he doesn’t remember. Have you ever held the door open for someone and not received a thank you? Happens to me all the time. I don’t keep a mental tally of who does and does not say thank you to me, and the guy you encountered likely doesn’t either. Since you are worried about seeing him in passing again, you can follow some of the advice in these comments.