I've been to topless optional and clothing optional resorts and since that is normalized, men don't go out of their minds, they don't stare or even get erections. So no, it's not really different for men - human bodies are just that until they are sexualized. There are co-ed nude saunas all over Europe, to say nothing of all the topless beaches.
As you said, deciding for women why they are doing what they are doing or why they are wearing what they are is internalized patriarchy - it's not feminism.
The image of the guys leering at the woman's foot speaks a thousand words. Good essay!