Missouri and Arkansas had more than their share of blood feuds that began before the war and continued long afterwards. Each location has its own variations to the same theme. In your area people of Scots-Irish ancestry usually hated foreigners in Federal uniform. This was also true in Virginia when Sigel's when German-speaking soldiers plundered the Shenandoah Valley. Southern women would scream and cry at the soldiers who came into their homes to steal and destroy. The Germans ignored their objections, saying only, "Nicht verstehen; nicht verstehen."
Many scenes in the movie "Cold Mountain" are hard to watch but Charles Frazier's descriptions are fairly close to history. In this scene Natalie Portman plays a widow of a North Carolina soldier. Three Federal soldiers come to her pitiful farm in search of provisions. Pending her revelation of where her valuables are hidden, the leader of this group decides to hold her infant child hostage. Unfortunately this clip starts with an ad. It's hard to watch, but unfortunately represents what kinds of things happened in many Southern homes. The conclusion of the scene is what Southerners wish might have happened, but rarely ever did. Thank you, Hollywood.
http://www.youtube.com/watch?v=xG7kLQh4Qn8
Let us know if you develop more information about the Hills of De Kalb County AL. It always feels good to get closure on one of these stories. Learning more about extended family members in that part of the world may provide more substance to your stories.