The name of the district comes from the town of Olmos, meaning "elms", because the palebark of the trees in the surrounding forest reminded the Spanish settlers of the elm trees back in Spain. At the time of the arrival of the Spaniards the area was occupied by the Quechuas and the extensive region of Olmos was administered by the Kingdom of Copiz, which was under the Inca Empire. The pre-existing town was recognized in 1544 by the viceroyBlasco Núñez Vela.