What We Know About William Gardner
William (Billey) Gardner may have been the only enslaved person from Montpelier to gain freedom during James Madisonโs lifetime.
Gardner was the son of โoldโย Anthonyย and his wifeย Betty[1]ย (and was possibly the brother of a younger man namedย Anthony, who would escape from Montpelier at age 17 in 1786).ย [2]ย All were enslaved by Madisonโs father, who transferred Gardner to Madison sometime prior to 1787 โ a transaction that was confirmed in theย elder Madisonโs will.[3]
Gardner likely served as Madisonโs manservant when Madison went to Philadelphia in March 1780 to attend the Continental Congress. Gardner was first mentioned there in July 1782, whenย Edmund Randolph suggested to Madisonย that โBillyย can remind youโ of the name of a particular enslaved person.[4]ย By this time the American Revolution was all but won, and liberty was in the air. Gardner apparently felt its influence, according toย a letter Madison wrote to his fatherย in 1783:
โOn a view of all circumstances I have judged it most prudent not to force Billey back to Va. even if could be done; and have accordingly taken measures for his final separation from me. I am persuaded his mind is too thoroughly tainted to be a fit companion for fellow slaves in Virga. The laws here do not admit of his being sold for more than 7 years. I do not expect to get near the worth of him; but cannot think of punishing him by transportation merely for coveting that liberty for which we have paid the price of so much blood, and have proclaimed so often to be the right, & worthy the pursuit, of every human being.โ[5]
Madison did not explain what prompted his urgency to make a decision between selling Gardner and sending him back to Virginia. Possibly Gardner had tried to escape; this would not be the only instance where the Madisons considered selling an enslaved person as a punishment for running away. Madison clearly feared that Gardner, now โtaintedโ with the desire for liberty, could influence other people enslaved at Montpelier to seek their freedom as well.
Madison seemed to be testing his own commitment to liberty in this letter. He knew the price paid for the coloniesโ liberty, he expressed sympathy for Gardner desiring liberty โ but he could not bring himself to grant Gardner his freedom outright. The only compromise Madison was willing to make was to accept a lower price for Gardner by selling him into short-term servitude in Philadelphia, rather than selling him at a higher price for lifetime servitude elsewhere.


Madison wrote to his father in September 1783, explaining his decision to sell Billey Gardner into short-term servitude in Philadelphia. โI am persuaded his mind is too thoroughly tainted to be a fit companion for fellow slaves in Virga.โ See above for a transcription of the highlighted section.ย Courtesy of Library of Congress.
Gardnerโs Next Chapter
While Madison referred to him only as โBilley,โ Gardner began using the full name William Gardner at some point after Madison sold him. (It is possible that he already had the surname Gardner, since the Madisons rarely acknowledged the surnames of enslaved people.) Gardner remained in Philadelphia, where Madison and Jefferson had occasional contact with him. In 1787, a year after Anthony escaped from Montpelier, Madison asked Gardner if he knew whether Anthony was in Philadelphia. (Anthony may have been Gardnerโs brother.)ย Madison wrote his father, โThe enquiries which I have at different times made of Billey concerning Anthony satisfy me that he either knows, or will tell [,] nothing of the matter.โ[6]ย A year later, Madison was still speculating on Anthonyโs whereabouts, andย wrote his fatherย with the suspicion that his current enslaved manservantย Johnย had โpractised a gross deception on usโ by implying that Anthony was in Philadelphia. Madison could see no reason for John to do this โunless it were a spite to Billey, which I fancy he entertained.โ[7]
By 1793 Gardner seems to have been working at Mary Houseโs boarding house in Philadelphia. Madison, now a U. S. Congressman, had ordered plows from a Philadelphia agriculturist. He sought Gardnerโs assistance to have the plows sent to him at Montpelier, where he had returned between Congressional sessions. Madisonย wrote Jefferson in May 1793ย regarding plans for shipping the plows: โBilly at Mrs. Houses was charged to look out for the first Vessel that offers. If the Newspapers shd. present one to your eye be so good as to let him have notice [,] that he put them on board.โ[8]ย Madison asked Jefferson to pay for the plows, adding inย another letter, โThe price will be made known by Billey.โ[9]ย Jefferson replied in July, ย โI have never been able to get a sight of Billy till yesterday. He has promised to bring me the bill of your ploughs which shall be paid.โ[10]ย Jefferson noted in his account book on August 24, โpd Billy Gardner for J. Madison 34.70,โ[11]ย andย wrote to Madison on August 25, โBilly who is just going on a nautical expedition to Charleston, called on me yesterday to desire I would send you the inclosed account which he said was necessary for you to debit those for whom the articles were.โ[12]ย Gardnerโs voyage to Charleston may have been related to duties he carried out as a merchantโs agent.
In addition to Madison calling on William Gardner for this type of odd job, Jefferson paid his wife Henrietta Gardner to do laundry. On January 10, 1791, Jefferson recorded in his account book, โBillyโs wife (Mrs Gardener) begins to wash for me at ยฃ20. a year.โ The account book records payments made to โMrs Gardner,โ โHenrietta Gardner,โ or simply โwasherwomanโ throughout Jeffersonโs term as Washingtonโs Secretary of State (1791-1793) and his term as Vice President under Adams (from 1797 until early 1800, when the capital โ and Jeffersonโs laundry โ moved from Philadelphia to Washington). On several occasions Billey Gardner collected the payments. The last time was on January 5, 1794, when Jefferson recorded: โpd Billy Gardner in full for washing 10.18.โ[13]
In late December 1795, Madison learned dismaying news.ย He wrote from Philadelphiaย to his father at Montpelier,
โYou may let Old Anthony & Betty know that their son Billey is no more. He went on a voyage to N. Orleans, where being sick as were most of the crew, & very weak under the operation of a dose of physic, he tumbled in a fainty fit overboard & never rose.โ[14]
William Gardnerโs life as free man had come to an untimely end.
References
[1]ย James Madison to James Madison Sr., December 27, 1795, James Madison Papers, Library of Congress, Washington, DC, accessed August 10, 2020, MRD-S 11057, Montpelier Research Database.
[2]ย โTwenty Dollars Reward,โย Virginia Gazetteย (Richmond, VA), November 22, 1786, accessed August 7, 2020, MRD-S 42360, Montpelier Research Database.
[3]Madison Sr.โs will, written in 1787, states, โI do hereby confirm to my son James a good right and title to the following slaves which I have heretofore given him to wit, Billy which he has since soldโฆโ James Madison Sr., Will dated September 17, 1787, James Madison Papers, Library of Congress, Washington, DC, accessed August 7, 2020, MRD-S 20954, Montpelier Research Database.
[4]ย Edmund Randolph to James Madison, July 5, 1782, James Madison Papers, Library of Congress, Washington, DC, accessed August 7, 2020, MRD-S 10241, Montpelier Research Database.
[5]ย James Madison to James Madison Sr., September 8, 1783, James Madison Papers, Library of Congress, Washington, DC, accessed August 7, 2020, MRD-S 10510, Montpelier Research Database.
[6]ย James Madison to James Madison Sr., July 28, 1787, James Madison Papers, Library of Congress, Washington, DC, accessed August 7, 2020, MRD-S 10780, Montpelier Research Database.
[7]ย James Madison to James Madison Sr., September 6, 1788, James Madison Papers, Library of Congress, Washington, DC, accessed August 7, 2020, MRD-S 21380, Montpelier Research Database.
[8]ย James Madison to Thomas Jefferson, May 27, 1793, James Madison Papers, Library of Congress, Washington, DC, accessed August 10, 2020, MRD-S 10948, Montpelier Research Database.
[9]ย James Madison to Thomas Jefferson, June 17, 1793, James Madison Papers, Library of Congress, Washington, DC, accessed August 10, 2020, MRD-S 10954, Montpelier Research Database.
[10]ย Thomas Jefferson to James Madison, July 21, 1793, James Madison Papers, Library of Congress, Washington, DC, accessed August 10, 2020, MRD-S 10964.
[11]ย Thomas Jefferson account book 1791-1803, Manuscripts and Archives Division, MS 23168, New York Public Library, New York, New York, accessed July 30, 2020, MRD-S 42851, Montpelier Research Database. This entry can be viewed on the 47thย image of theย digitized account bookย (click on the โDigital Assetsโ button).
[12]ย Thomas Jefferson to James Madison, August 25, 1793, James Madison Papers, Library of Congress, Washington, DC, accessed August 10, 2020, MRD-S 10980, Montpelier Research Database.
[13]ย Thomas Jefferson account book 1791-1803, Manuscripts and Archives Division, MS 23168, New York Public Library, New York, New York, accessed July 30, 2020, MRD-S 42851, Montpelier Research Database. These entries can be viewed on the 5thย and 53rdย images of theย digitized account bookย (click on the โDigital Assetsโ button).
[14]ย James Madison to James Madison Sr., December 27, 1795, James Madison Papers, Library of Congress, Washington, DC, accessed August 10, 2020, MRD-S 11057, Montpelier Research Database.
[15]ย James Madison to James Madison Sr., December 27, 1795, James Madison Papers, Library of Congress, Washington, DC, accessed August 10, 2020, MRD-S 11057, Montpelier Research Database.

Senior Research Historian