My boss told me I only got the job because I was the only one that had applied.

My boss told me I only got the job because I was the only one that had applied. Recently my boss told me to my face that I only got my current job because I was the only one that applied. He said had a fluent speaking also applied that they would have got the job over me no matter how qualified they were, but just on the merits that they were fluent and I wasn't fluent. Seemed like an inappropriate conversation to me. I've already found another job. Do you think I should report this person to human resources? I've never had anything like this happen before.