Yes, the units were good. The two I am most familiar with -the 17th Tennessee Cavalry Battalion (part of Miller's Regiment) and the 12th Mississippi Cavalry Battalion were both experienced units by 1864. Perhaps the hostilities between Ferguson and his superiors kept the brigade from its proper due in reports.
Although I would note that in February 1864, during the Meridian campaign, just after Ferguson's Brigade was placed under Jackson's command, there does not seem to have been any animosity between Jackson and Ferguson. In his after action report, Jackson commended his own brigade commanders Starnes, Ross, and Adams - and also stated, My thanks are due General Ferguson for his gallantry, energy, and prompt compliance with all orders while temporarily serving under my command.