Casanova was an inveterate gambler who never had much money. Ben Franklin didn't have much compared to the ladies of the French court he was charming. Kissinger was powerful, but so were a lot of men in America who were way better looking than he was who didn't have the same success with women…
Unless these men were in the habit of flashing their bits to women they were trying to seduce, the women would never know about their "endowments" until long after they'd fallen for the men.
Wealth, just like physical attractiveness is certainly nice, but not something that truly makes women go crazy for men in the way that so many women were mad for Casanova and the others.