Charlton began his career with Canterbury in 1948 and spent six seasons with the club playing a total of 61 games. In 1954, Charlton moved to Western Suburbs and played 143 games for the club. Charlton was a member of the 1958 and 1961 sides which made the grand final but were on the losing side against St. George on both occasions the latter playing as captain. In 1962, Charlton joined Eastern Suburbs and spent two seasons there before retiring. Charlton also played for New Souths Wales on three occasions between 1959 and 1961.