You should definitely tell him. As I see it, there will be two outcomes. If he reacts poorly, then you dodged a bullet. And if he is fine with, he might appreciate you even more for being honest.