There was a Captain William Gaston Henderson who served in the cavalry as a member of Company B (Chickasaw Rangers), Jeff Davis Legion.

A capsule history of this unit can be found here.
http://mississippiscv.org/MS_Units/Jeff_Davis_Legion.htm

In the 1860 Chickasaw County (MS) Census, this man is listed as a 28 year old Lawyer born in NC. Also listed in this household is his wife Dona, age 24 born AL, and daughter Laura, age 2 born MS.

Captain Henderson was selected for the "Roll Of Honor" in the Battle of Upperville, Virginia.
http://64.233.169.104/search?q=cache:ZJGhSvXl34EJ:www.civilwarhome.com/honorrollgettysburg.htm+battle+of+upperville,+mississippi&hl=en&ct=clnk&cd=1&gl=us&ie=UTF-8

There is also evidence from this newspaper article that the Jeff Davis Legion later participated in another battle at Upperville, Va.
http://dlxs.richmond.edu/cgi/t/text/text-idx?c=ddr;cc=ddr;type=boolean;rgn=div3;q1=upperville;op2=and;q2=jeff%20davis;op3=and;q3=legion;view=text;subview=detail;sort=occur;idno=ddr1079.0026.099;node=ddr1079.0026.099%3A3.2.4

(You will have to copy and paste the URL above)

This William G. Henderson survived the war and was serving as Postmaster in Biloxi according to the 1900 Harrison County Census. He and Dona are buried in the Biloxi Cemetery.
http://www.findagrave.com/cgi-bin/fg.cgi?page=gr&GSln=henderson&GScid=641002&GRid=8985552&

Military service records for this soldier are available here.
http://history-sites.com/research/index.html