If my poor memory is correct not all of the research, particularly such things as engineering design, was done at Oak Ridge. Most of it was farmed out to several other institutions and labs so as no one would know exactly what they were working on and even fewer people saw all the parts put together.

I believe that Georgia Tech was one of those designing centers that made some parts for the machines at Oak Ridge and for "Fat Man" and "Little Boy"