Confederate soldiers captured by Union military forces should have compiled service files. These include almost any records available at the National Archives asembled from surviving Confederate records as well as Federal prisoner-of-war records.
Of course you can order service files using the banner seen above on this page.