This is odd.

The man in question appears on post-war census records as being black, and a life-long resident of Virginia.
The stone marker looks as if the inscription was inset in a U S shield. But note the CSA marker.