It would appear that he did not return to the regiment after they were exchanged following their Vicksburg parole.
Jeremiah L. Stover
Residence White County GA;
Enlisted on 7/10/1862 as a Private.
On 7/10/1862 he mustered into "B" Co. GA 52nd Infantry
(date and method of discharge not given)
He was listed as:
* POW 7/4/1863 Vicksburg, MS
* Oath of Allegiance 3/5/1864 Chattanooga, TN [place of residence listed as White County, Georgia]
* Released 3/5/1864 Chattanooga, TN