Do your best to let him know that at the very worst it doesn't bother you, and at best, you think it's attractive.