In 1861 this organization was known as Miller's Mississippi Cavalry Battalion. Company letter designations may have changed when the regiment organized, but there is a John J. Martin in Co. "E".

Given your description Miller's Cavalry Battalion is the only choice available, which makes identification easy.