Carterville was said to have been settled in the 1860s and was named for a family of local settlers. In the 1960s, the community reached its population zenith of 75. There was a business, a town hall, and a church in Carterville in 1983. The population went down to 25 in 1990 then grew to 39 in 2000.