Hi, I have concluded the James Borge who first served in Co. B "Captain Borge's Company" of the Garnet Rangers Militia (New Orleans) afterward joined the Pointe Coupee Artillery. James Borge served in the PCA at least into late 1864. No record of his service shows up after that last surviving muster roll of the PCA but I think he is also Horatio James Borge b. about 1829 and died in New Orleans in 1882 leaving behind a wife and many children. He never reached above the rank of private during the war.
If I read correctly you said Garnet County Rangers and if so, as you know, Louisiana has no counties, thus could be Alabama.
Good luck.