That's toxic patriarchy, that's why we need to bring down the patriarchal system of our society. It hurts women and men in different ways and feeds both our insecurities or creates them even, where there should be none. I'm not sure men have it worse than women (never experienced it as a man, and I don't want to speak about something I don't know), but I understand for sure that it can be really difficult to live.