Mathew Brady wanted Dolley Madison.
Having the beloved former First Lady sit for a portrait in his studio would be a significant coup for the up-and-coming photographer. A mutual friend provided a letter of introduction, assuring Dolley that Brady โcannot think his gallery complete without adding your face to his interesting collection.โ1ย Dolley complied. The sitting, on July 4, 1848, produced several daguerreotypes of Dolley seated by herself โ the image that Brady had been keen to capture. But it also produced an intriguing double portrait. Perhaps at Dolleyโs request, or perhaps because Brady recognized Dolleyโs affection for her young companion, Brady also photographed Dolley with her niece Annie (Anna) Payne.
Sweet, Sensible, Sterling
Annie was born in 1819, the third of the eight children of Dolleyโs brother John Coles Payne and his wife Clara (Clary) Wilcox Payne. In the 1820s and 1830s, the Paynes lived on a farm within the bounds of the Montpelier tract (which James Madison later bequeathed to John).2ย Annie and her siblings practically grew up with their Aunt Dolley.
Dolley described 11-year-old Annie as โa sweet one, & very sensible.โ3ย Teenaged Annie enjoyed the neighborhood social life. Dolley wrote in December 1834, โAnna & her sisters have gone to a dancing party at Newmanโsโthey are to keep the Christmas from this time to New Years day.โ4
Both Annie and her oldest sister Dolley sometimes stayed overnight at Montpelier, keeping Aunt Dolley company. When James Madison was away at a Board of Visitors meeting at the University of Virginia in October 1826, Dolley Madison wrote to her husband โJno. & Clary spent Sunday with me, & I keep Dolley to sleep in your place.โ5ย In 1835, Annie stayed at Montpelier while James was ill. Dolley wrote in May, โAnna who is a sterling girl stays much at home with me and sleeps beside my bed ever since the illness of Mr. Madison in April.โ6

Mathew B. Brady, daguerreotype of Dolley Payne Todd Madison and Anna Payne Causten, 1848. Courtesy of National Portrait Gallery, Smithsonian Institution; gift of Dortha Louise Dobson Adem Rogus, descendant of Dolley Madison.
Constant, Affectionate, Enthusiastic
The Payne nieces helped care for their aunt after she was widowed in 1836. In February 1837, John Payne wrote that his daughter Annie was part of โthe permanent female share of the Montpelier family,โ7ย suggesting that Annie was living with Dolley full-time by then. When the Payne family moved west in 1837 (to Illinois and later Kentucky), 18-year-old Annie stayed behind at Dolley Madisonโs request. Dolley, John, and Clara had discussed the plan for Annie to remain with Dolley, and Dolley promised that Annie would be well provided for and would be in a position to help her parents. (The Madisons expected the sale and publication of Jamesโs papers to yield ย at least $100,000, based on what was paid to John Marshall for his biography of George Washington.)8ย As close as Annie was to her Aunt Dolley, saying goodbye to her parents was difficult. She wrote in 1837, โPapa and all have been gone two months & four days โฆ How little we thought then that in June we should be separated byย 800 miles! โฆ I often look out for them without reflecting but they are goneโThe only tears I ever saw papa shed was when we parted. Oh, how sad our parting was!โ9
For the next 12 years after that tearful parting, Annie was Dolleyโs โpersonal and constant affectionate attendant and companion,โ in the words of a family friend.10ย She accompanied Dolley on extended trips to Washington and back again to Montpelier. She stayed busy โreading & improving her self in many desirable things,โ as Dolley explained in 1840,11ย adding to another friend that Annie โcommenced taking French lessons in March which has engrossed herย wholeย time, & mind.โ12ย Annie also became, as her aunt described her, โa young enthusiast on the subject of autographs,โ building a collection that included signatures of Alexis de Tocqueville, James K. Polk, and even William Penn.13


This Bible was a gift from Annie โFor my dear Aunt on her birth-dayโ in 1845. Courtesy of Montpelier, a National Trust historic site.
Joyous, Precious, Of Great Assistance
In 1842 Annie and Dolley traveled to Philadelphia and New York. A relation in Philadelphia was pleased that Annie and Dolley would be attending a ball there, writing, โI am sure Miss Payne will enjoy itโshe appears to have so joyous a disposition.โ14ย Annie also enjoyed parties and other social events in the capital city whenever she and her aunt visited. Dolley wrote a cousin in 1842, โAnna is on the wing to Mrs. Websterโs party and I must put a finishing stroke to her dressโฆโ15ย In 1844, when Dolley sold Montpelier, Washington became Dolley and Annieโs permanent home.
Annie not only provided company and cheer to Dolley, but also assisted her with tasks such as correspondence. Mary Cutts, another of Dolleyโs nieces, recalled: โMrs. Madisonโs handwriting was the Italian, but late in life it became laborious and painful for her to write, so much so that after Mr. Madisonโs death, when his, as well as her own correspondents overwhelmed her, she taught her niece Miss Payne to imitate it. After much practice, she was so successful that none but those perfectly familiar with the penmanship of both, knew the difference. This was of great assistance. The letter Mrs. Madison would begin; as soon as her eyes ached, the pen would be transferred to Miss Payne, who continued to write under her dictation; then she would herself add the last words and the signature.โ16
In July 1845, Annie and Dolley shared the experience of being confirmed at St. Johnโs Episcopal Church. Dolley, born a Quaker, noted that the Episcopal Church was โthe Church which I have attended for the last forty yearsโand which Anne has generally attended, all her life.โ17ย Annie had given her aunt a Bible as a birthday gift in May 1845, perhaps anticipating their upcoming Confirmations.
Because Dolley and Annie were so close, they both worried over each otherโs health. After Annieโs extended illness in 1845, Dolley wrote, โI feel the conciousness of a dull spirit which for the last three months has bound me in the fear of loosing a very precious Neice whose health is now being restored, & mine in consequence is recovering.โ18ย Dolleyโs final illness in July 1849 was a hard blow for Annie. Dolleyโs nephew James Madison Cutts wrote on July 11 that Annie had been nursing Dolley through the night, and โher watchings & affectionate solicitude for Aunt has made her ill โ she has fainted from exhaustion now so frequently & is with all so ill that the friends around Aunt begin to have equal anxiety for one & the other.โ19ย After Dolleyโs death on July 12, Annie โinsisted upon going to the Church, at the funeral of her Auntโbut, at the door, fell lifelessโ in a faint.20ย Annie was ill in bed for several weeks and recovered at The Highlands, the home of her friends the Nourse family, just outside the capital city. Mary Cutts noted that Annie had been โquite sick โฆ with the return of her old complaint,โ21perhaps connecting it to Annieโs prior bout of illness in 1845.

St. Johnโs Church, Washington, DC, 1918-1920 photograph.ย Dolley Madison and Anna Payne were both confirmed at this church on Lafayette Square. Courtesy ofย Library of Congress Prints and Photographs Division,ย National Photo Company Collection.
Dolleyโs final willย had divided her most valuable asset โ a trust fund established when she sold James Madisonโs papers to the federal government โ between her son John Payne Todd and her โadopted daughterโ Annie Payne. (Dolley never legally adopted Annie, but often used this term to describe their relationship). Payne Todd challenged the will, which had been signed on Dolleyโs deathbed. This led to years of legal wrangling, resolved only by his death in January 1852. Although this final will made no mention of Dolleyโs papers, an earlier had will expressed Dolleyโs wish that Annie would sort these papers and burn any private letters. Annie apparently considered herself honor-bound to fulfill this wish, even to the point of barging into Dolleyโs house with another niece, Ellen OโNeale Cutts, to retrieve a carpet bag full of papers.22ย (For more on the destruction of Madison papers, seeย Where Have All the Papers Gone?)
Devoted, Cheerful, Laughing
With Dolley gone, Annieโs nearest relatives were hundreds of miles away. Perhaps Annie considered joining them out west, but in the meantime a new relationship blossomed for her. Itโs unclear how Annie met Dr. James Causten Jr., although the extended Causten family was part of Dolleyโs Washington social circle. The two married in April 1850, and welcomed a daughter Mary in August 1851. Letters between Annie and James portray a loving family group. Annie often addressed James as โDarling Dear,โ23ย signing herself โYour devoted wife.โ24ย Annieโs letters include fond descriptions of Maryโs antics: โYou ought to see the Baby with a great piece of bacon in her hand, eating & talking away to your Daguerreotype. She is too sweet.โ25
Annie was beloved by Jamesโs family as well as by James himself. Annieโs brother-in-law wrote to her after she had returned home from a visit, โThe house has lost its life โ the cheerful voice and hearty laugh of our dear sister Annie is wanting โ I can well understand how it was that Jimmy found home without you so dreary.โ26

Anna Payne Causten, portrait by Charles Bird King, 1852. Courtesy of the Dolley Madison Collection, Greensboro History Museum.
Both Annie and James seem to have had chronic health problems. In November 1852 Annie was too ill to attend Payne Toddโs estate sale, where she hoped to obtain more of her auntโs papers as well as furnishings with sentimental value. Her father-in-law, James Causten Sr., agreed to attend the sale on her behalf, but as he explained, โbefore I returned to Washington her spirit had fled, and my first melancholy duty was to attend the deposite of her remains in my family vault, by the side of her Aunt Mrsย Dolly P. Madison.โ27ย Washingtonian Anna Maria Brodeau Thornton noted in her diary on November 10, 1852, โMrs. Anna Causten died last Eveng. She was ill a long time.โ28
Annie was only 33 when she died. Her husband James died four years later, leaving daughter Mary an orphan at just five years old. Mary was raised by her grandfather Causten and her aunts and uncles. While the Caustens no doubt cared deeply for the young girl, Mary missed knowing her sweet, joyous, affectionate mother Annie, Dolleyโs โsterling girl,โ who had delighted in her own โprecious Mary.โ29

Senior Research Historian