Elmo was the son of Marlin J. Walters and Sarah Rhoads. Elmo's name is also given by some sources as Walters. He married on June 28, 1924, to Elizabeth Murphy. They appear in the 1930 census of Vandergrift, Westmoreland County, Pennsylvania. No children were listed. Vandergrift was their last known residence.