James Harvey Raisor was born ca 1798 in Pittsylvania County, Virginia to George 'Abraham' Raisor and Elizabeth Witcher. The grandson of two revolutionary patriots. His maternal grandfather, MAJ William Witcher, was a notable, justice, colonial planter, constable, early miller, and Virginia Militia officer.

MAJ Witcher's daughter, Elizabeth, married a neighbor, George 'Abraham' Raisor, who had served in her father's company, during the Revolution. That union produced at least seven children over more than 30 years of wedded life. Alas, we learn from one of their descendants,* that Abraham abandoned his wife and children, ostensibly because of Elizabeth's "irascible" [sic] temper.

But, who knows what goes on between a couple. This may have had an effect on the young James Harvey's development as he was married three times: first to [Esther] "Hettie" Shoemaker on 16 Aug 1825, in Spencer County. Their children include:
• Sarah "Sally" RAISOR (1826 – ?)
• William ‘Henry’ RAISOR (1827 – 1880)
• John M RAISOR (1830 – 1906)
• Elizabeth RAISOR (1833 – 1891)
• Adam RAISOR (1835 – 1864), CSA
• Lavinia RAISOR (1837 – 1901)
• Delilah “Lila” RAISOR (1838 – 1895)
• David B. RAZOR, CSA (1839–1911)

James' second marriage to Elizabeth Miller probably produced ten more children:
• Loretta "Laura" RAISOR (1841 – 1909)
• Lydia RAISOR (1844 – ?)
• Matilda Ann "Tilda" RAISOR (1845 – 1916)
• Lavina RAISOR (1845 – ?)
• Julia Ann "Juliana" RAISOR (1849 – 1921)
• Amanda RAISOR (1852 – ?)
• Martha Jane RAISOR [RAZOR] (1854 – ?)
• Margaret Ann RAISOR (1858 – ?)
• James 'Harvey' RAISOR Jr. (1860 – 1932)
• Edwin RAISOR (1864 – ?)

As far is presently known no children came from his union with Susan Morris.

James Harvey was a master blacksmith a map showing his shop and his home is attached.