"Exactly where was this "rest of the country" that voluntarily gave up slavery before it was made law by the 13th amendment?"
Well, Massachusetts, Pennsylvania, New York, Connecticut, Rhode Island, New Hampshire, and New Jersey all had legal slavery at one point. All of them voluntarily passed laws ending the institution (often gradually) within their borders. The other states of the North rejected or excluded slavery from their origins.