On 12 June 1971, the 72-year-old Yang was engaged to the 47-year-old Chen Tsai-feng, his housekeeper. Initially, Yang's two adult daughters opposed the marriage. Eventually, his daughters and their husbands finally gave up and attended the engagement ceremony of their father. His great-granddaughter is Natalie Lin, a comedian in New York City. On 5 February 1984, the 86-year-old Yang married to the 61-year-old Chung Yu-yeh in a traditional church ceremony.