What people find threatening is that he’s using his pseudo-science as a justification for hierarchies that have historically and in the present disadvantaged women and people of color, by saying that said hierarchies are natural and therefore right. He’s not the darling of the alt-right for nothing, even if he claims that they misconstrue his intentions.