You may be interested in a chapter from this book.

A history of Columbus, Mississippi during the 19th century. Lipscomb, W. L.. Columbus, Miss.. S.D. Lee Chapter of the Daughters of the Confederacy. 1909.

Chapter XIII is devoted to Columbus during the Civil War.

The author, Dr. William Lowndes Lipscomb (1826 - 1908), was a resident of Columbus for 78 years. His service in the CSA included duty as Post Surgeon in Columbus.

This book is available online at Ancestry.com, a subscription is required.