Found the following at www.tshaonline.org/shqonline
From Southwestern Historcial Quarterly Volume 066 July 1962

Col Robert T.P.Allen was commandant at Camp Ford Nov 1863 until May 15,1864 when Lt Col John P.Border assumed command. Actually Col T.Scott Anderson was the commandant but he stayed in Tyler and left the day to day operation of the prison to Lt Col Border.
I find Col Robert T.P.Allen in the 17th Tex Inf I have no idea if he was on dettached duty or if the 17th actually guarded prisoners.
Mike