The primary problem is the mainstream norm that domination and control of women (and weaker men) is a part of how you demonstrate masculinity in this culture. Although drinking and jock/frat culture do contribute to rape culture, it's not confined to those places by any means.

In cultures where women are actually respected and a balance between male and female is viewed as desirable, rape functionally does not exist, in part because it is considered highly unmasculine to do so.

Rape Is Unknown In Some Cultures

“Rape may be a way of proving one’s manhood, an important concern for adolescent males.” In rape cultures, dominance and control over women become aspects of achieving and experiencing masculinity, and rape, while not condoned, becomes part of the culture at large.