My Patterson family also has a John Withrow Patterson.
Born: 31 May 1839 in Southwestern NC (Buncombe or Haywood County). His parents (Robert Patterson & Margaret Withrow) removed to Gilmer County GA abt. 1845 with four children: Jonathan Marion, John Withrow, James Caldwell (my great grandfather) & Louthetta. While in GA, two more children were born, namely, Susan Cansade & Joseph. According to the Civil War Pension Application of "our" John Withrow Patterson, his family arrived in Texas about 1859 (Parker County) and he served in the Confederate Army in Texas. Our John Withrow Patterson died 8 Aug 1925 in Hamlin (Jones County) TX.

Who are the parents of your John Withrow Patterson?