I would think that they would have buried him somewhere in the vicinity of his death so he may be in an unmarked grave. Any hospital records indicating the location may have been lost during the evacuation of Atlanta.

I somehow doubt that the resources or railroad tracks would have been available to ship his body by rail back home to Mississippi...the summer of 1863 was not a particularly good one for the Confederates in that area.