I believe his common-law wife Rachel, had been a slave of his grandfather. I also think he had his son from his first marriage marry Rachel's daughter from a previous relationship and his daughter married on of her sons.