Hi Richard,
Georgia did indeed have a Jewish colony of sorts, mostly in Savannah, but also in Macon and Columbus too. One Jewish officer from Columbus, Edwin (or Edward) Moise, raised a cavalry company from Columbus.
I have no idea what became of the alleged Jewish company from West Point, GA - perhaps they did affiliate with some other unit, but Georgia had no all-Jewish regiment that I have ever heard of either, so who knows where they ended up.
Sadly, none of the articles that mention them ever list names which would be critical to tracking them down.
Greg Biggs