Stowe was born in Oak Park, Illinois. He graduated from Kent School in 1958 and Cornell University, class of 1962. After that he joined the U.S. Navy and was dispatched to Vietnam, where he rowed at the Club Nautique in Saigon. He returned from Vietnam as a lieutenant, and was stationed in Philadelphia, where he joined the Vesper Boat Club.