However, this did not happen because those captured soldier of Arkansas Post were exchanged at City Point, Virginia and therefore didn't return. This "holding Regiment" became Hardy's Regiment with the resignation of Col. Dawson to keep from confusing it with the 19th and 24th Arkansas consolidated that fought the remainer of the war with the Army of Tennessee.
Hardy's Regiment remained detached at Sulphur Springs during the rest of the spring and summer of 1863. It is mentioned (but not specifically by name) in Gen. Daniel Frost's report from Fort Pleasent of troops in the Pine Buff area for the defence of the lower Arkansas River in May of 1863 in the O.R.'s. In July 1863 Hardy's regiment is attached to Frost Missouri Brigade (8th and 9th Missouri Inf.) and leaves Sulphur Springs with Frost Brigade in late July '63 when they move to Little Rock to take position in the Little Rock defences. That is why many of the service records of Arkansas soldiers, of the 19th and 24th Arkansas who died at Sulphur Springs, found their way into Missouri records.
Hope that fills in some of the gaps that may have been in your Grandfathers service records.