This is a second-hand account, purported to be the recollection of a conversation, made years after the fact by a political opponent, that aligns with little or nothing else Grant is known to have said or believed politically. It doesn't even sound like Grant's way of speaking or writing. Like anything else in historical inquiry, judge it carefully and take it for what it's worth, I guess.