Sometimes prisoner 'exchanges' were just bookkeeping: the prisoners were not actually in custody - they had been paroled or, in this case perhaps, they did escape, but the Union still 'exchanged' them for Union prisoners.
Are there military records for the time in question? They might show whether he was present with the unit or still in Camp Morton.