Yes, don't take it personally. He's probably assuming that it would make you too uncomfortable. Just mention it to him in private after class.