Ben --
Nearly all militia commands being based on age, occupation and residence, by law a citizen belonged to the militia rather than joining. You could try to join if you're weren't eligible.
Let me suggest that you check the Georgia militia roster of January 1864, which many libraries have.
If I may ask, how old was this man in 1864, and where did he live? Answers to those two questions will help locate him.