Terry --
The information you provided seems fair indication that this man was not a Confederate national. You may not be aware that Federal prisoners-of-war who signed an oath of allegiance and enlisted in Confederate service served in a "Foreign Legion."
In my personal version of "The Way Things Ought To Be", Boston would be a city in a foreign country. In 1862 I'm sure the authorities in Richmond VA thought of Massachusetts that way.