According to the 1860 Census about 80% of the cotton mills of the US were located in the New England states, New York, New Jersey, and Pennsylvania.
1860 Census (Manufactures)- http://www2.census.gov/prod2/decennial/documents/1860c-01.pdf