James was married to Margaret Jane Mitchell on 7 Mar 1814 in Madison County, Ohio. They had at least nine children. James and his wife, Margaret died about 1838/1839. It is unclear whether they were in Indiana or Ohio, at the time. No memorial has been identified in either place.