Bryan,
I've done some more looking and found an index of the Confederate burials at the Confederate Hill Section of Loudoun Park Cemetery. The man you're looking for was a member of the 54th NORTH CAROLINA Infantry, not Virginia.
Here is some info from Ancestry.Com. You can also purchase this man's Compiled Military Service Record through the link below.
Name: T Scott ,
Residence: Burke County, North Carolina
Side Served: Confederacy
State Served: North Carolina
Service Record:
Enlisted as a Private.
Enlisted in Company B, 54th Infantry Regiment North Carolina.
Died of disease as a POW Company B, 54th Infantry Regiment North Carolina on 3 May 1865 at Baltimore, MD.
Jim Martin