Funnily enough, each state did things a bit differently. Sure, slavery was a factor, but it wasn't the sole factor. States rights were a huge part of it. The Nullification Crisis was a definite and significant precursor to South Carolina rejecting the federal government and ultimately leaving the Union. Clearly this was an issue of states rights and not chattel slavery.