Orson married Lydia Hunt, both natives of New York, with whom he reportedly had nine children, 8 of whom are shown in census records. They lived in Kent county, Michigan for some time, with all their known children listed as born in Michigan. The family was in Neosho, Kansas as of the 1860 census. Orson enlisted in Co. E, 5th Kansas Cavalry in 1861, and was soon promoted to the rank of Sergeant, with duties consisting of general scouting in Arkansas. Son Henry Clay, who enlisted with Orson, died at Helena, Arkansas, and some years later was reburied in Memphis National Cemetery. Orson was discharged for disability in 1863 at the rank of Sergeant, and collected a disability pension beginning in 1890. Sons Wright Hunt Peck also served with his father, while Theodore Frelinghuysen Peck (twin of Henry Clay) served in another unit. Following the war, Orson and son Wright opened a tin shop in Burlington, Kansas. His family was shown in Lowell, Cherokee county, Kansas in the 1870 census, where daughter Francis was buried the previous year at the age of 15. The family relocated to the Lompoc temperance colony in 1874, where Orson opened a hardware store. He was one of the founding members and deacon of the First Baptist Church, which met at his brother Edwin's home until Edwin's death, then Orson's home until a church was built. Edwin, a Civil War veteran of Michigan, is buried in this cemetery. Orson remarried four times, buried here with those wives. In his will, he left money to his housekeeper, Laura Redden, to whom he had proposed to be his 6th wife at age 88, but she declined the offer. She was the widow of the first minister of the church, and was still under the age of 50. In 1985, the headstones of Orson and 3 wives were vandalized; Hannah's had been down prior to that time, and Rachael's was left standing.