The issue of Black Confederates is important to some folks for one reason, and one reason only. It's their "Get Out of Jail Free" card to show that Confederates did not harbor racist sentiments, and to "prove" that the Civil War had absolutely nothing to do with slavery.
You are correct about Sherman and Grant. Sherman in particular was adamant that no USCT units march with his army corps in Georgia or the Carolinas.