People who don't like him will find anything they can to make fun of him. It's the same thing bullies do. If someone is fat, make fun of their weight. If someone is short, make fun of their height. It's just the lowest-hanging fruit.