According to the local history of Baldwin, Florida in 1846 the town was called Thigpen. The town name was later changed to Baldwin after a railroad executive.

I have not found when the railroad came to Thigpen.

Just a guess on my part I have always thought that the song may have been referring to Abner Doubleday who was second in command at Fort Sumter.