The Cedar Bluff cemetery began as a family burial ground on the homestead of Hiram and Isabella Vincent King. While at a picnic on a hilltop of the homestead, one of the King daughters expressed that the spot was so beautiful that if she were to die, she would want to be buried there. Sometime later she became ill and did in fact die. She was buried according to her wish and became the first grave at the site. The field stone marking her grave was later joined by a line of stones marking other King family graves. Isabella's niece, Nancy Jane Robinson Detherow, was buried in front of the King graves. Her gravestone would later be joined by a line of stones marking Detherow family graves.
An unknown family traveling through on their way westward lost a daughter and buried her remains in front of the Detherow line. They built a cairn to mark the grave before moving on.

The family graveyard became a church graveyard in 1921. At that time the King homestead was owned by Hiram and Isabella King's daughter, Elizabeth (Betty), and her husband, Tom Varner. The Cedar Bluff Baptist Church had been organized in November of 1910 at the home of Ben Crismon just one mile east of the cemetery. The church had begun meeting in the Cedar Bluff School House which was also in the vicinity. In November of 1921, the church accepted an offer from Tom and Betty Varner to give the cemetery and the adjoining property to the church as a place to build a meeting house. In exchange, the church would take care of the cemetery.
In 1945, Gene Brady and his wife Lillie bought the homestead from the Varner heirs. In the 1980s, Gene gave additional land to the church to expand the cemetery.
Through the years, the church house and the cemetery have become a special place to the families who share a connection with the church and community. Over a century after the original gift, the church continues to use and maintain the cemetery.