Because they tend to be the ones refusing to listen to the stories of other more marginalized peoples. They too often make excuses, deflect, say "It's not really that bad," or "Look how far we've come."

The real problem is that a patriarchal dominance based hierarchy is a zero-sum construct, and so you either win or lose (and somebody has to lose in order for somebody else to win). In a different social construct, there's room for concern about everyone and instead of trying to figure out how to make the other person lose so you can win, there are possibilities of win-win scenarios. That's the direction that we need to be moving in, if you ask me.