Madison, now known as the “Father of the Constitution,” was a slave-owner in Virginia, which at the time was the most populous of the 13 states if the count included slaves, who comprised about 40 percent of its population.
During that key speech at the Constitutional Convention in Philadelphia, Madison said that with a popular vote, the Southern states, “could have no influence in the election on the score of Negroes.”
Madison knew that the North would outnumber the South, despite there being more than half a million slaves in the South who were their economic vitality, but could not vote. His proposition for the Electoral College included the “three-fifths compromise,” where black people could be counted as three-fifths of a person, instead of a whole. This clause garnered the state 12 out of 91 electoral votes, more than a quarter of what a president needed to win.