Lime Rock, WisconsinLime Rock is a ghost town in Outagamie County, Wisconsin, United States. Once located in the town of Seymour and the town of Osborn, the ghost town has no surviving buildings.GeographyLime Rock was located at, with an elevation of 851 feet.