Cathy --
A military service file will help you eliminate most guesses about 'whens' and 'wheres' for this soldier. Copies of these records are available here.
The Long Arm of Lee, a two-volume study of artillery units serving with the Army of Northern Virginia, should provide the contect for the service files of men who served in this battery.