Sorry - thought Fort Marion and Matanzas were the same installation. We made a visit many years ago -- I wondered the same thing. Confederates probably occupied the site until evacuation of Jacksonville and St. Augustine, but the NPS should know.