"my (mistaken)impression was they panicked and "scattered"'
The Union Naval reports would give a person that impression. But from what I read the fact is that they never set eyes on any Confederate Soldiers except those in the Hospital. So they were writing these reports in a selfserving manner.
These Confederates were well aware that they were outnumbered and that they were attempting to save those guns for use at a later date and were not there to give battle. So being unable to move these guns to Little Rock without an engine and upon seeing these Gunboats and Troops Transports approaching, What would you do?
Naturally the Yankees are going to say that you ran away.