That's baloney. Southern people had no more responsibility for John W. Boothe, who was a demented shirker, than for the tyrant Lincoln.
As was pointed out earlier in this thread, many Southerners had Tory ancestors. My ggg-grandfather was born and raised in Poucheepsie, New York because his family had to leave South Carolina and New York was much safer for Tories. As a young man, he moved to Georgia, married a Southern woman, then Texas in 1834 and lived happily after....until Lincoln's War.