You keep referring to non-racist whites but then pointing out all the ways that the vast majority of whites actually are highly racist. They may not overtly hate blacks and other races in the way that white supremacists do, but most of racism doesn’t look like that, as I’m sure you are well aware.
Maternal mortality rate for black mothers is 3 to 4 times as high as it is for white women, and is similar to that in places like Uzbekistan. That’s not due to white nationalist hostility, it’s due in large part to subconscious bias, something that most white people have to greater or lesser extent.
People who are worried about no longer being in power are acutely aware that it has conferred privilege and that those who they have tolerated being systemically abused may turn and do the same to them if they get the chance. That sounds pretty racially charged to me.