Richard, all 9,075 Lafayette County residents are listed that way in 1850. The census enumerator may have entered a political district instead of the township or community.

A better bet for pinpointing your ancestors' location might be land patents, if he entered government land, which can be searched here: http://www.glorecords.blm.gov (If not listed, try the nearest neighbors shown in the census)