Born 29 MAY 1831 in Brown Co., OH.
Died 11 DEC 1891 in Douglas Co., MO.

Married Matilda Ralston in 1853 in Ohio

1860 Census:
Andrew J Penny
Age in 1860: 29
Birth Year: abt 1831
Birthplace: Ohio
Home in 1860: Scott, Brown, Ohio
Post Office: New Hope
Household Members: Name Age
Andrew J Penny 29
Matilda J Penny 24
Viola J Penny 5
Vergin O Penny 4
Christian G Penny 2

1870 Census
Name: Andrew J Penny
Estimated Birth Year: abt 1831
Age in 1870: 39
Birthplace: Ohio
Home in 1870: Lincoln, Linn, Kansas
Post Office: Jackson
Household Members: Name Age
Andrew J Penny 39
Matilda J Penny 34
Viola J Penny 15
Virginia Penny 14
Christian Penny 12
Verlenia Penny 9
Clement L Penny 6

This would lead me to believe if he served it was likely an Ohio Unit. Checking NPS 3 hits come up under Andrew Penny including the most likely Andrew J Penny Company D 59th OVI organized at Ripley, Brown Co, Ohio.

From Dyer's
59th Regiment, Ohio Infantry

Organized at Ripley, Ohio, September 12, 1861. Moved to Maysville, Ky., October 1. Nelson's Campaign in Kentucky October-November. Action at West Liberty October 21. Olympian Springs November 4. Ivy Mountain November 8. Piketown November 8-9. Moved to Louisa, thence to Louisville and to Columbia, Ky., December 11. Attached to 11th Brigade, Army of the Ohio, to December, 1861. 11th Brigade, 1st Division, Army of the Ohio, to March, 1862. 11th Brigade, 5th Division, Army of the Ohio, to September, 1862. 11th Brigade, 5th Division, 2nd Corps, Army of the Ohio, to November, 1862. 2nd Brigade, 3rd Division, Left Wing 14th Army Corps, Army of the Cumborland, to January, 1863. 2nd Brigade, 3rd Division, 21st Army Corps, Army of the Cumberland, to October, 1863. 3rd Brigade, 3rd Division, 4th Army Corps, Army of the Cumberland, to September, 1864. Unattached, 4th Division, 20th Army Corps, Dept. of the Cumberland, to October, 1864. Tullahoma, Tenn., Defences of Nashville & Chattanooga Railroad, Dept. of the Cumberland, to October, 1864.

More on the 59th can be found at http://www.ohiocivilwar.com/cw59.html

However this record would indicate not him:

Name: Andrew Penny
Enlistment Date: 21 Oct 1862
Side Served: Union
State Served: Ohio
Service Record: Enlisted as a Private on 21 October 1862 at the age of 19.
Enlisted in Company D, 59th Infantry Regiment Ohio on 21 Oct 1862.
Died of disease as a POW Company D, 59th Infantry Regiment Ohio on 6 May 1864 at Andersonville, GA.

But in the same index is this listing:

Name: Andrew Penney
Enlistment Date: 21 Oct 1862
Side Served: Union
State Served: Ohio
Service Record: Enlisted as a Private on 21 October 1862 at the age of 19.
Transferred into Company I, 59th Infantry Regiment Ohio on 21 Oct 1862.
Mustered Out Company I, 59th Infantry Regiment Ohio on 16 Jul 1865.

The NPS system indicates this as being the same individual so there is a discrepancy. I'd suggest going to the CSRs to work it out from here.

The other Andrew Penny served per pension records in the 11th (3 Months), 48th 3 years, and the the 2nd Reserve Battn. There is no wife listed on the pension index card and he was granted an invalid pension on January 12 1887, # 412254 There is no state of filing on the card either.

John R