One could wonder which situation was the worst. To live in an occupied town or area or be in one of those border areas that had two opinions? I hate to admit it but Pensacola seemed to be treated pretty well by the Union after they took control. Of course, most of the residents who were for the Confederacy took themselves off to Greenville, Al. and the city government went along with them and performed up there for a city they were not in. There are stories that have been handed down about some ugly instances such as the Union burning out an ill old man and his daughters in Millview because they had 'seen' a Confederate soldier.
It does appear as if the 'border' states and many innocent people took some brutal punishment for not deciding one way or another.
Pam