I am not sure about a "family" connection. But maybe a friendship.

Since we are being partisan here, if I were the President of the Confederacy and my Capitol was about to be overrun, why would I grab a dirty, tore up, striped rag and carry it in my personal baggage as I was making my departure?

What value did it have to Davis?