Joseph Sheppard was the son of Thomas Henry Sheppard and Mary Catherine Boykin. His sisters were Leah Sheppard Overstreet, Nina Sheppard Boykin, Louisa Sheppard Stevens and Elizabeth (Bessie) Sheppard Pryor. His brother was Watson Sheppard.
Joseph H. Sheppard and Martha Adella Sheley were married in 1910. They had four children: Doris Sheppard Hodges, Raymond Sheppard, Edell Sheppard Bazemore and Edith Sheppard Carter. Joe was a farmer and lived in the Middle Ground Community his entire life and was a deacon in the church.
He was a kind and much loved grandfather and is still missed very much by his grandchildren.