No wonder you have trouble finding him. So far I have found some very conflictinginfo , including deathdate and name. Have you ever him of him referred to as Andrew Jackson Garrett?
As near as I can tell he died before 1872 possibily in Union Co. Georgia.
GP