The MDAH has him listed as Gober, Elijah C., private, Co D, 1st Regt Lt Art (Wofford's Battery) Co D, was from Holmes County. He is not listed in the 1860 or 1870 Amite CO Census, but is listed in the 1850 Holmes Co census. (I don't have access to the 1860 Holmes census)
Co D was organized in early 1862. Surrendered Vicksburg, July 1863. ExchangedSept 12, 1863. Surrendered by "Dick" Taylor May 4, 1865
Battles:
Vicksburg bombardments May 18-July 27, 1862
Vicksburg Campaign May-July 1863
Mobile March 17-Apr 12, 1865
HTH
Virgil