Ernest was the son of Alice Lively, and step-son of R.B. Lively. He was the grandson of Margaret Isabel Brian Franklin. He came to Erath Co Tx in 1903. He spent his life in Central Texas according to his obit. He was a member of the Church of Christ. He married in 1923. He had several step- brothers and two step-sisters.