This sounds like Union General Davidson's Raid through the Florida Parishes in December 1864. The author may have been in the 2nd New York Cavalry.