His first wife, Janet Murray, died of pneumonia in 1935. Their older son, David, became a pianist, organist, composer, and radio announcer, before dying in 1964 due to a cerebral hemorrhage. Janet was from a rather wealthy family in small-town Iowa, and is buried there with their 2nd son, who died shortly after birth.