He left home at the age of 15 and came to Dekalb County from Rockmart Georgia. Rev. Garner and Ben Shirey started the New Bethel Baptist Church from a brush arbor. New Bethel is where Rev. Garner preached his first sermon, and he also performed over 50 marriage ceremonies many of which took place at their house.