A C.M.A. Rogers was living in Sumter County in 1870.

1870 Sumter Co. Census

399B 29 29
Rogers C.M.A. 31 M W Farmer Ala
Rogers Ann E. 31 F W Keeping House Ala
Rogers John A. 8 M W Ala
Rogers M.B. 7 F W Ala
Rogers Sallie 3 F W Ala

The age is exactly right to be your Charles McPherson Aduston Rogers, b. 1839.

I don't have access, at the moment, to earlier census records for Sumter Co., but I can tell you that both Rogers and Rodgers families are found on Sumter Co. censuses as early as 1850.