I would have to ask when he had time to get married and have children. The 1860 census lists him as age 15.
If you have the name and birthdate of John E. Flemming's child from whom your are descended, it would make it easier to provide an answer to your question. More than one man named John E. Flemming served from Alabama.