I haven't read Sherman memories. So this is a different story.
But the point is that blacks in the Confederacy were used in more than mear servants roles in the southern army. And most of those references have been forgotten for the sake of political reasons.