Mr Lincoln took this position during the greater part of his political career. Most slaves and former slaves didn't want to leave, even it it was a free trip.
http://www.mrlincolnandfreedom.org/inside.asp?ID=34&subjectID=3