It is worth noting that the 2nd Florida was one of the units implicated in the murders of black Union soldiers after the Battle of Olustee. I've not done research of my own into the topic, but the topic has been addressed in a couple of the books on the battle.
There were also rumors and allegations of attrocities after the Battle of Natural Bridge, where a battalion from the 2nd Florida was engaged. I researched these, however, and found them to be unfounded. All MIA's from the USCT units at the battle were accounted for and wound up in hospitals or at Andersonville.