A B Moore's "Conscription and Conflict in the Confederacy" documents many of the state conflicts with the Confederate government. For example, was a state militia officer a state official? In nearly all cases civil officers (yes, that includes JPs) were exempt from Confederate service. They could, however, be called into the state militia.
Similar conflicts took place in most other states. I can give particulars for Alabama.