Also, since that was so close to the state line, he might have been in a Florida unit, the following John Kellys were in 3rd Florida Infantry which had men recruited in Madison County, FL.
Kelley, John M.
Confederate
Infantry
3rd Regiment, Florida Infantry
Kelley, John W.
Confederate
Infantry
3rd Regiment, Florida Infantry