There were two Provost Guard companies in Arkansas that I know of, one each at the posts of Little Rock and Fort Smith.
There's a good book that deals exclusively with the Confederate Provost Guard -- "Rebel Watchdog: The Confederate States Army Provost Guard," by Kenneth Radley [LSU Press, 1989]. A very informative book about a subject seldom written about.