It really is bonkers, and flies in the face of actual history (not an invented one), actual sociology, and actual data obtained by asking women what they want. Overwhelmingly, men do not know who a woman picked when she didn't pick him - and assuming it was someone taller, richer, or buffer allows them to continue to scapegoat women without actually having to do anything to work on their personalities, or other "soft skills."
When you almost completely take away a woman's right or ability to support herself in any meaningful way and tell her the only path to security is to "marry well" then of course that's who women are looking for, but that's a dynamic that has only existed for the past couple hundred years and isn't really true today. These kinds of men need to stop projecting, stop scapegoating, and grow up.