The link you should see above, titled Military Records Research Services, was created for people with needs like yours. The more you know about this man, the more likely the right military record can be identified.
John T. Gregory appears on the rolls of the regiment you mentioned. Another man by the same name can be found with Co. "F", 41st Tennessee Regiment.