I could not find a DeGruy family that would match the above information, however, I found in the 1860 Federal Census for New Orleans...
Francois Degruse, Father, age 55, Mulatto
Julie Bonnans, Mother, age 48, Mulatto
Charles Degruse, son, age 24, Mulatto, Bricklayer**
Louis Degruse, son, age 22, Mulatto, Clerk*
Joseph Degruse, son, age 21, Mulatto, Cooper
Eugene Degruse, son, age 19, Mulatto, Cook
In the S&S System there are...
Louis DeGruy, *Lieutenant, 74th U.S.C.T.
Charles DeGruy, Private, 96th U.S.C.T. (formed from the Corps De'Africa **Engineers)
Eugene DeGruy, Private, 73rd U.S.C.T.
There is also a Eugene DeGruy, private in Company F of the Cresent Regiment La. Inf.
I know the issue with names in New Orleans and DeGruy could be pronounced Degruse or vis versa. Look at the brothers employment listed in the census and look at their military record. Also the U.S.C.T. units listed for these men have links to New Orleans.