Kavanagh graduated as one of the finest batsmen of his school and played his first representative game for Southland in the inaugural Hawke Cup of 1910–11, which saw Southland forced to play two away games and win. Kavanagh captained Southland several times and in 1921, he was called on to play against Australia. Those of his club and representative teammates claimed that but for a flaw in his concentration when compiling an innings, he would have been one of the best left-hand batsmen in New Zealand. He was also a top class spin bowler and a brilliantcover point fieldsman. Moving to the North Island, Kavanagh went on to play for Waikato, Hawke's Bay and the North Island XI.