Jeri,
From the notation of money left in Atlanta, it would seem that he may have died there. At the time there was a railroad running from Chattanooga to Atlanta so it's reasonable to assume that he was sent there.
Try a search on Gate City Hospital on the Georgia board of this forum. Apparently some soldiers from that hospital were buried in Oakland Cemetery in Atlanta. The Oakland Cemetery society will check for burials via email or phone, here is the link:
http://www.oaklandcemetery.com
Also, here is a little information on the hospital:
http://ftp.rootsweb.com/pub/usgenweb/ga/military/civilwar/hospitals/atlanta.txt
Hope this helps,
Scott