However......
1850 Census for Sumter County has him listed as "Merchant" and 1870 census as "Dry Goods". Couldn't be located on 1860 census.
A Macon Weekly Telegraph (Feb 2 1875, pg 2) article on the history of Americus (Sumter Co) has in the prominent citizens a "J.J. Granberry, Esq." meaning lawyer.
Busy man.