Let's turn this around. I can tell a story or two about men from my home county who were violent racists. You might have known others like them many years ago. Let's say we collect fifty or more stories about violent racists in Southern communities during the 1960s. Does that mean that tens of thousands of white Southerners who lived in these communities must have all been violent racists?
I think not.
Projecting behavior or attititudes from a small sample to a much larger group isn't really fair, and doesn't make for good history. It's just a means of confirming what you want to believe.