Social norms theory says that because these attitudes are still so prevalent (although not as much as they used to be) that often men assume that other guys aren't as uncomfortable as they are and so they don't speak up. It takes courage to potentially be the outlier but it is important and men will probably find that often they are not the only one who isn't OK with something like that after all. Glad you've got such a good friend group - that definitely helps.