Well my great-grandfather was in Monroe County, TN and a Captain in the 59th. My dad said he left there after the War because of the unionists. In 1877, he settled in Southeast Kansas and kept the title of his land in his nephew's name for several years but I don't think he kept his Confederate service a secret.
Recently, I saw one Confederate stone in old Madisonville Cemetery that is engraved "Confederate veteran" and he died in 1917.
It seems like many of the Confederate veterans left that area of TN after the War For Southern Independence.