I agree with you, in that Southern leadership did not make slavery an issue just when it pleased them - in fact, those leaders helped make slavery an issue constantly for decades.

The difference here is that in 1850, those leaders had no compunction against having the federal government involve itself in state affairs, when it was to their advantage to do so. Those same leaders were wailing about sacred state sovereignty before and after, and especially in 1861.