Henry was born at "Clermont".
Son of Sydney Smith Lee and Anna Maria Mason Lee.
His grandfather was Lighthorse Harry Lee. His uncle, Robert E. Lee. His brother, General and Governor Fitzhugh Lee. He was a decendent of George Mason through his mother.
He married Sally Buchanan Floyd, their children:
William Floyd and
At the outbreak of the Civil War, he joined the "Richmond Howitzers," and later was transferred to the staff of General W.C. Wickham, where he served as Adjutant General.
Sally Buchanan Floyd Johnston Lee
1848–1925 (m. 1868)