If any cause could be given, they were fighting against conscription, and that is questionable. These same men had no trouble volunteering to fight against the Union. Most likely they were homesick, since other men of their class, a few, went to New Orleans and actually joined the Union cause for the rest of the war.
David