The son of George and Ann Ambler Fisher was a highly respected businessman in Richmond. He was a large scale miller. Fisher also authored "History and Reminiscences of the Monumental Church, Richmond, Virginia from 1814 to 1878". He was the Sunday School Superintendent there.
Edward H. Fisher