It appears there were in fact two different James Baltimore's in Fluvanna County at the same time and of about the same age. The James Baltimore, listed in the Virginia Regimental Series book as having been captured 3/65 at Winchester, sent to Point Lookout and later paroled was the son of James and Sara Baltimore. I had to find his marriage information to determine this. The James Baltimore that is mentioned in The Bulletin of the Fluvanna County Historical Society, no. 41, April 1986, and no. 42, October 1986 as having died April 1864 at Orange Court House was the son of Richard and Martha Baltimore. I looked at the Fluvanna County Death Registry and there is a listing for "Ballimore(Baltimore) James, died 6 Apr 1864 Orange CH of diptheria aged 18. Richard Baltimore reported. There is only one Richard Baltimore listed on the 1860 census.
So I have to ask. Is it possible that two people with the same name served in the same unit? It may be hard for us to determine for certain, but it's hard to discount with the above information. I've searched the Civil War Soldiers and Sailors System, and there is two listings for James. One in the unit that was eventually combined to form the Second Battalion Fluvanna Artillery and one for the Second Battalion Fluvanna Artillery. I tried a search under the last name Ballimore, but nothing came up.
I'm open to any advice/suggestions... anything.