German Evangelical Zion Cemetery was established in July of 1849, when two farmers (Henry Baur and Daniel Mueller) who were members of the church donated adjacent property for a church building and cemetery. This area of St. Louis County was settled heavily by German immigrants who established this congregation in 1838. The property is still owned by what is now known as Parkway United Church of Christ, located on Ballas Road about two miles from the site. The last burial at Zion Cemetery was around 1907. By that time, Elm Lawn Cemetery (est. 1861) was the primary location of burials for the church. Both cemeteries were known as Zion for several years in the early 1900's. Most of the burials were infants and children, many suffering from cholera and other respiratory problems occurring during the cold winter months.

Some time in the 1950's Old Zion was heavily vandalized, and most of the headstones were taken by a farmer to use as fill for ditches. Until recently, there were only two headstones remaining at the grounds. One was the tiny monument of Catherine Alt, a four-year old girl who died in 1853. The other is the headstone of George Mueller, a Civil War soldier who served in Company K of the 12th Missouri Infantry. George died of disease in 1863.

In May of 2009, a headstone from Old Zion was found by a hiker in Eureka, Missouri, about 20 miles from this cemetery. It was the headstone of young mother Maria Elisabeth Schlueter, age 25, and her baby Maria, age 2 days, who died in 1854. The stone was returned and reset at its original location. In June of that year, a ceremony was held at the old cemetery, rededicating the headstone and honoring the pioneers of the church who are buried there. The names of everyone buried at Old Zion were read aloud, some by their own descendants who are members of the church today.

Old Zion is located in Windmoor Subdivision about halfway between Clayton and Manchester Roads off the outer road of Highway 270 in St. Louis County, Missouri.