Matthew,
By the summer of 1863 I think a lot of the distinctive finery that marked a soldier as distinctly a Mississippian had disappeared - but if they were wearing something, it was probably a star on the hat, as it was a very popular symbol with Mississippians. Also, you would probably find some men still using a few Mississippi buttons on their jackets.
I hope this helps,
Jeff