Go by the Alexandria Historical & Genealogical Library at the corner of 5th & Washingtton Streets. They have a pretty good museum and can point you to where you need and will want to go. Just ask for Dale.
You can check out Bailey's Dam, what's left of it, and the forts and there are other good sites in the area. Ft. DeRussey is just down the HWY near Marksville and about an hour drive up I-49 will bring you to the Mansfield Battlefield. Greenwood Plantation, the ancestral home and burial place of Brigadier Leroy Stafford is down HWY 71 at Cheneyville, about 1/4 mile before you hit the city limits. Mr. Gordon Ewing, the current owner is a descendent/relative and is usually more than happy to let folks look around the place and visit the cemetery. Burr's Ferry Historic site is about an hour and some few minutes west of you near Leesville. Lloyd's Hall Pantation is just south of Lecompte and you may even want to visit the National Cemetery where many Union soldiers were interred. The Kent House is a good visit too. There are others but like I said, run by the library and get directions etc. before you start They are not open on Monday so tomorrow is a good time to start.
If you are still around on the first Tuesday of next month stop by the library at 7:00 P.M. and visit with our SCV Camp, named in honor of General Stafford.