Remember the "Luxury Taxes" passed a few years back, on big ticket "Rich people" items, like R.V.'s and Yachts? What happened? No body bought those items because of the high taxes that were added on to the price. As a consequence manufacturers closed and thousands of workers were layed off to draw unemployments checks, instead of pay checks.
Any higher taxes help no one, least of all the "Little Man". That was true in 1860, and its true now. You know what rolls downhill, and you know who will be at the bottom.
The South depended upon it imports and they could not stand for higher import taxes or allowing the United States Army, at Fort Sumter, to bottle up their largest harbor.