Soon after Lee reported to Richmond for duty, Arlington House was occupied by yankee officers and became their headquarters.
Union troops looted the house and many priceless artifacts from Mount Vernon, Mrs Lees family (Martha and George Washington), were stolen.
Later just for spite Union dead where buried in Mrs Lees rose garden and right outside the front door of the house. This was done to keep the Lees from ever returning. These graves later became the beginnings of Arlington National Cemetary.
Lee would never again return to his home.