Not at all. They received paroles and went home, just like men of the Army of Northern Virginia. General Lee explained the terms in his 'farewell address', General Order No. 9:

http://www.civilwarhome.com/leeorder.htm

Note the second Pp.