Because it's not that simple or cut and dried, and in the history of the world, including the present day, men are demonstrably the ones hurting women - physically, sexually, emotionally... It's not that no man has ever been hurt by a woman. Clearly that is something that takes place, but there is no grand societal dynamic where that is a part of the fabric - unlike with patriarchy, where there is such a grand social dynamic.
It's victim blaming, it's unnuanced, and it's not helping men's lives improve either. It's just making the Tates and the Petersons of the world richer at your expense, and keeping men from doing any real self-assessment or inventory in favor of blaming it all on a scapegoat.
TL:DR You are a victim of patriarchy, same as women are, but instead of blaming the system, you are blaming women. Feels good, perhaps, but doesn’t actually move the ball.