Sexual dimorphism is only about 15% in humans, with a wide variety of latitude of heights in both men and women. Patriarchy is a social system that is extremely hung up on gender binaries as well as the restrictive notions of what it means to be "a real man." A large part of this includes "not being feminine in any way." It's also a dominance based hierarchy where attaining enough power to rise in the pecking order is the way you get ahead. Height and being physically imposing is one of the ways to signal dominance in a culture where that matters - and it doesn't matter in all cultures.
In a patriarchy, women aren't supposed to take up space -either literally or figuratively. Here's a great story on that.
https://forge.medium.com/what-happens-when-women-start-taking-up-space-4ce5a3206853
"The association of power with height is a socially constructed phenomenon: taller bodies are institutionally and discursively imbued with power" - in a dominance based social system such as patriarchy.
https://etd.ohiolink.edu/apexprod/rws_etd/send_file/send?accession=bgsu1219422665&disposition=inl
It only seems natural to you because it's so ubiquitous. "The Black Death was a bubonic plague pandemic that had claimed millions of Afro-Eurasian lives. Historians consider this as the most fatal pandemic recorded in human history. Researchers have claimed that after the pandemic, men gained around 9 centimeters in height, whereas, women got 5.5 centimeters shorter. The increase in height in men was perhaps because men were provided with better nutrition compared to females who did not receive adequate nutrition. Scientists have proclaimed that the development of height in adults is strongly dependent on nutritional intake and health during childhood."
https://thescienceserve.com/2021/03/18/why-are-men-taller-than-women/
I could go on - and perhaps I will in a stand alone story at some point. The idea that men must be bigger than their female mates is absolutely a socially constructed aspect of living in a patriarchal dominance hierarchy.
