Is there a particular state that this unit hailed from?.... which might be missing in its designation...

There was no 34th "Confederate" Cavalry (mounted nor dismounted)

Frederick