James S. Headley was born on October 2, 1792 in Maryland to parents James and Jane Elizabeth Patterson Headley. He was the couple's second child and first son; younger children in the family included Marshall Headley and Alexander Headley. He married Malinda Atchison in Fayette County in 1825. Together the couple would have four sons: Hamilton "Hammie" Atchison, George Washington, James Alexander and William Headley. James passed away on April 17, 1884 at the age of 92 in Fayette County, Kentucky. He is buried in the Lexington Cemetery in Lexington, Kentucky.