Without trying to be unkind to anyone, does it really matter?
Things of that nature are private and anything said at this late date would be using hindsight from the present, not sensible information
from the past.
For all we know the man got his heart broken by some sweet lady who died prior to marrying him. My own great grandfather outlived three women, two of whom he married and one that he was only engaged to.
I seriously doubt that the fact that he was homely was of great importance. Many women in that day and time, just as today, would marry a man because of his importance regardless of his looks.
Without trying to offend but just offer my opinion.