Ballard played college basketball at Colgate, where he was a two-time Patriot League Academic Honor Roll selection, and served as team captain his senior year. He is a devoted member of the young male's mentoring group known as "the Commission" which prides itself on the development of young men in highly competitive academic environments.