James Madison Skelton moved to San Saba County, Texas between 1881 and 1884. He was a charter member of the Baptist Church at Locker. He and his wife Sally attended church regularly and brought most of the congregation home with them for a "SING". They all loved to sing. He said he was born in Madison County, Alabama and was named for the county. James Madison Skelton died of a stroke on April 8, 1926.