Son of Edward Worthington Dorsey and Eleanor Elizabeth Brown.
Caleb migrated with his family from Maryland to Pike County, Missouri about 1835,
After his brothers, John Worthington Dorsey and Thomas Beale Dorsey left for the mines in California in 1849/50, he ran the family farm until the Civil war broke out. Caleb joined the Missouri Guard cavalry under Sterling Price. The whole family worked hard to support the Confederacy. At the end of the war, Caleb moved to California, establishing a very successful farm in Oakdale, Stanislaus county, California with his brothers. His mother and sisters joined them by 1870.
Mariposa Gazette, 25 April 1896
Colonel Dorsey Killed
Colonel Caleb Dorsey of Stanislaus county was shot and killed in the mountains above Columbia, Tuolumne county by his mining partner, a man by the name of Newcomer, on the 21st instant. It is supposed that they quarreled about a quartz mine in which they were jointly interested and as a result Dorsey was killed as above stated. Colonel Dorsey was an old resident of Stanislaus county and at one time a prominent politician. He had represented his county in the State Legislature. He was a confederate Colonel under General Price during the late war. At the time of his death he was a large property owner and resided near Oakdale in Stanislaus county and about 65 years of age.