Dexter, IllinoisDexter is an unincorporated community in Effingham County, in the U.S. state of Illinois.HistoryThe Dexter post office closed in 1926. The community's name honors Josia Lufkin Dexter, a local pioneer.