actually i belive the whole story is here.
http://www.nps.gov/archive/liho/debate4.htm
The reply was not to Douglas but --- well I'll let ya'll read it.
By '63 Lincoln could say pretty much waht he wanted. The tide was turning against the South, he has control of the North, who is going to object?
GP