Jacob was the 6th of 7 children of of George Rowe and Maria Keppel of Westmoreland County, Pennsylvania. He married 1st to the daughter of John and Margaret Page. He married 2nd on December 30, 1845, to Elizabeth Smith. He married 3rd on April 19, 1855, to Eliza Haenon. She was born about 1826.