Alan, I understand about the slave ownership. Plantation owners had more to risk than anyone. Mijamen was a lawyer and never owned many slaves and it really is not germane to the subject. What is relevant is that had he been outspoken and critical of the Confederacy, he would not have stayed in office during the entire War.
It was after the War, when he became a Republican and occupied office during Reconstruction that he ruined his career.