You're perfectly in the right for what you said, which wasn't even that bad imo. You explained to him, he ignored you and hung up then acted as if it didn't happen