You would appear to be on the right track. The company referenced was the "Claiborne Rangers" of Claiborne County --
http://mississippiscv.org/MS_Units/16th_MS_INF.htm