Howdy,David !
The reason is to be found that there were many in the upper south and the border states that wasn`t for letting the Union to dissolve than the issue of slavery.
For the northerners to enter in the CSA it is more probable that slavery played a role for their choice.
That is the impression I have the differences in the numbers you presented.
Roy H