It is a human issue, but both the CDC and The Who consider violence against women to be at epidemic levels and of utmost concern. That's because violence against women has particularly properties to it - already extensively enumerated so I won't go into them again - that mean that nearly all women are at risk of violence in a way that only a small subsection of men are.
And, I challenge you to have meaningful conversations with all the women that you know, including you mother, aunts, grandmothers, etc., about their experiences with fear, with sexual harassment and violence as well as other types of violence - because what you are going to find is that pretty much all of them, of any age, any political or other demographic difference have multiple experiences with this starting from a young age. This is not something that most men have stories around because the vast majority of men have never been treated like prey animals in public, in the workplace, etc.
This doesn't mean that violence against men isn't important - again, already stipulate to that multiple times in the OP. It means that too many men (apparently, you included) just have no idea how bad things are for women, and what nearly all women's lives have been like, and when presented with this, they want to deflect, rather than care - something that is needed in order to improve this dynamic both for women and for everyone.
Saying that historically men were often flogged for beating their wives is a complete re-imagining of actual history. Wives were considered property to be done with as you wish. Beating your wife wasn't even a crime in the US until 1920 - and even then it wasn't until the 1970s — when feminists began demanding better — that anyone began to even minimally enforce that. Even then, the police frequently asked women what they had done to "make him do this." Sir Patrick Stewart watched this happen to his mother repeatedly and heard that question time and again. He is consequently a huge advocate for women to this day. Marital rape wasn't a crime in all 50 states until 1993 FFS!!
I'm all for shelters for men, increased awareness that they can also be victims, and all of those things, but you rather obviously need to do a better job of educating yourself on this topic because you're misconceptions are myriad. Here's a place you can start.
"The situation was barely tolerable: I witnessed terrible things, which I knew were wrong, but there was nowhere to go for help. Worse, there were those who condoned the abuse. I heard police or ambulancemen, standing in our house, say, "She must have provoked him," or, "Mrs Stewart, it takes two to make a fight." They had no idea. The truth is my mother did nothing to deserve the violence she endured. She did not provoke my father, and even if she had, violence is an unacceptable way of dealing with conflict."