I have had the same problem- beginning to think that "J" stood for "Just-keep-looking."

However, I have seen one genealogy chart for the Jones family that lists the father of Egbert J. Jones as JOHN. So it may be a first name, rather than a last.