I think it's backlash to progress and it feels uncomfortable to conservatives who want to "conserve" a way of life where everyone knew their place and white men were the undisputed top of the hierarchy. This isn't necessarily always overt sexism or racism, but because the old status quo was inherently unfair, wanting to preserve it still comes off that way.