Robert Moss is the son of Hardy Paul Moss and Adaline Rutherford. His father is a Union Civil war veteran, which seems odd but Hardy Moss was from the eastern part of Tennessee so his loyalty was for the Union. The Moss and Rutherford's are very old stock in Tennessee and were in that state as early as the 1790's or early 1800's. Robert Moss was married to Ellen Wallace. They had four children: Walter Moss, Frank Moss, Margaret Moss-Montgomery and Lillian Moss-Granberry.