What you may want could be here. Note that there were two Company "H"s in this regiment:

http://www.tngennet.org/civilwar/csacav/csa21cav.html

You may order a Confederate service record through this message borad:

http://history-sites.com/research/confedrecs.html