David is Seward's quote about slavery only being a vote getter to be found in "The Diary of a Public Man, Unpublished passages from the secret history of the American Civil War and Abraham Lincoln's early Administration, 1946."
Now, that's a quotable quote, plus it makes sense not unlike all the more popular vote getter phrases today!