A.J. (Jack) Gardner had a niece name Rebecca who was 19 in 1860. How old was Riley? She was the daughter of his brother John (age 42) and Harriet Gardner. I think you are really on to something. Jack Gardner had a son-in-law, Robert T. Buchanan, who "deserted" the 50th TN in late December afer they re-organized from the Camp Douglas prisoner exchange. Family history states neither Jack or Robert were home from the War at least as late as the second Battle of Dover on Feb. 3, 1863. Robert moved his family to Texas in the early 1880's. Jack had been a member of the household, but he stayed behind.
I too have often wondered if these men were partisans. Randy Ruebel stated a few years back that Co. E of the 10th TN Cavalry was detached to assist Captain Jack Hinson in cutting telegraph wires in the spring (or summer?) of 1863.
Send me an e-mail sometime. I have a cousin in Dover who is a direct descendant of John Gardner, perhaps through Rebecca.
Joe