The Colonel sounds like Alexander W. Caldwell of the 27th TN Infantry, who indeed lived in Memphis in the 1860s. I have no information that he was ever a prisoner, however.