After a temporary teaching engagement at St. Joseph's University, Avery was hired by Swarthmore in 1959 and taught there until his retirement. He served as Chair of the Department of Modern Languages from 1975 to 1980. His student, Jonathan Franzen, portrayed Avery's manner of teaching in his memoirs.