Dear Ma'am,
The 34th Georgia was the sister regiment to the 39th Georgia in Cumming's Brigade, Stevenson's Division. They were paroled on 8 July 1863 and officially exchanged on or about 12 September 1863. Please refer to my web page (link below) and and read the page "Prison & Parole". This will explain the parole and exchange system. The 34th Georgia's parole camp was in Dalton, Georgia. Please let me know if you have any questions.
Respectfully,
Gerald D. Hodge, Jr.
War Between the States Historian
Warner Robins, Georgia
Historian: 39th Georgia Volunteer Infantry Regiment
http://39thgavolinfrgt.homestead.com/39thHomepage.html