If your ggrandfather filed for a pension from the state of Mississippi, it would only appear at the State Archives in Jackson. This would be post 1890 on.
I visited their offices in 1998, but have forgotten what else they hold.
I suggest you contact them for a listing of their holdings.
George Martin