I feel your pain. Long ago someone wanting to join the UDC offered me 'proof' that her ancestor served in the Confederate army. The family heirloom was a discharge from the 1st Florida Cavalry, U.S.

As you mentioned, you have no way of knowing the real reason this man switched sides. Personally I believe most would say they wanted to be left alone, just my opinion.