Mike and David,
Could it be that the New Englanders had an intense dislike of the "English Lifestyle" of the Southern states. It had only been a few years since the revolution and the states of Virginia, Georgia and the Carolina's had a very aristocratic system among the well to do. We see that even during the war when the landed gentry went off to war with man servants. I remember reading the other day, I think it was on this site about a servant who went to prison with his master rather than abandon him.I understand the wealthy being unhappy after the war. They either had to pay someone to pull weeds or do it themselves.
Frank