I can't argue one way or another on who felt more threatened. The North does not seem a likely winner to me because the addition of the new states and a territory or so tilted their power side of the scale on the slavery issue.
At times, disagreements between the sections popped up and slavery was not the issue. The common denominator in almost every dust-up, argument, debate or watering contest was taxes and tarriffs.
Pam