He was born ca. 1819. He married Anna Julia Eldridge on January 2, 1852 in Elbert County, Georgia. Anna died in 1884. They had no children.
Milton Fuller and Mary Dunn (daughter of John and Matilda [Holloway] Dunn) had the following known children: Paul Milton Fuller, Jesse Vandiver Fuller, Mary Frances T. Fuller and Amanda B. Fuller. These children sometimes used Fuller and sometimes Dunn as their surnames.