According to Names in Stone, Volume 1, he is buried in Petersville Episcopal Cemetery. He was the son of Nicholas Gouverneur and Harriet Kortright (1770-1842), whose places of burial are unknown as of September 16, 2014. Harriet's sister, Elizabeth Kortright, was married to President James Monroe. He married their daughter and his first cousin, Maria Hester Monroe, on March 9, 1820 in the White House. He and Maria were the parents of three children: James Monroe Gouverneur (1822–1885), who died at the Spring Grove Asylum in Baltimore, Maryland; Elizabeth Kortright Gouverneur (1824–1868) who married Henry Lee Heiskell and Samuel Laurence Gouverneur Jr. (1826–1880), who married Mariah Campbell (1821–1914) and became the first United States Consul in Fuzhou (known as Foo Chow at that time), China. In September 1851 he married his second wife, Mary Digges Lee (1810–1898), who was the granddaughter of Thomas Sim Lee (1745–1819). They resided at the Lee estate known as Needwood, which according to the on-line Archives of Maryland is located in present day Frederick County, Maryland.
The Evening Post Tuesday, October 10, 1865
New York, New York
The Late Samuel L. Gouverneur
Samuel L. Gouverneur died on Friday, September 29th, at his residence, Needwood, near Harper’s Ferry. Mr. Gouverneur was the son of Nicholas Gouverneur, an old and respected resident of this city and well known to many of our older citizens. Early in life, when a promising member of the bar, he married the daughter of President Monroe and served as his private secretary during his two Presidential terms. He was subsequently appointed postmaster of the city of New York and held that position under President Jackson. Many years since he retired from public and professional life and has lately resided with his wife by a second marriage, a Miss Lee, of Maryland, near Harper’s Ferry, in that state. Mr. Gouverneur was genial and accomplished and possessed a remarkable faculty of gaining friends wherever he might be. His death will be regretted by many who remember his lively and interesting conversation and his courtly manners.