Fowler was born in Sydney and his family lived in Wallacia when he was a child. He attended Newington College. In 1908, his grandfather John Fowler was appointed postmaster in the town we now know as Wallacia and he became an alderman on the MulgoaMunicipal Council. His father Bernard Noel Fowler was an Independent Mayor of Penrith in 1956 and 1957. His older brother, Ross Fowler, was a Liberal Mayor of the same city on three occasions: 1995–1996, 2013–2014 and 2018–2020.