His first wife, Carol Love Bacon, who has since died, ended in divorce. He was married and divorced his second wife, Jeanie Kortum. He is survived by his four children; Crystal Williams Stermer; Megan Stermer; Christopher Stermer; and Colin Stermer; and five grandchildren.