He was the son of Abraham Harmon and Ann Pillars Harmon. On the 8th of March 1855 he married Elizabeth Ann Gant or Gault. They had at least 4 children. On 15 Oct. 1873 he married Mary Elnore Jay Delaney. They had 1 daughter. He was just 44 years old when he died.