I don't have anything on his height and weight. The best source on him, other than the Wyeth and Jordan/Pryor Forrest books, is the article the Memphis Appeal had on his reburial there.
One addition to the book I can make: prior to the war, in addition to running a livery stable, Jeffrey helped in his brother's slave-dealing business in Vicksburg, MS.