Im sorry this is happening to you. Is he a narcissist? He certainly has no empathy. I think you should draw the line and if he still does it, he will reveal his true character and you will have to be en guard whenever you see him.