"Historians have defined planters as those who held 20 or more slaves." You'll find this number used as a standard by most scholars. Of course this means slaves of all ages: men, women and children.