What an interesting question! I've never thought about it before. I looked through the Regulations of the Armies of the Confederate States (1864 edition) and find no regulation which covers the issue of horses for infantry officers. There's all kinds of regulations concerning cavalry and artillery horses, but nothing in connection with the infantry.
I'm going to have to defer this question to someone who knows something about this.