It's possible that the private was on detached duty / furlough /sick leave in Vicksburg and got caught up in the siege.