Has five children: daughter Sarah (b. 1958), daughter Charlotte (b. 1960) and son Hugo (b. 1962) with his first wife, Sally Ronaldson; daughter Natasha Gregson Wagner (b. 1970) with second wife, actress Natalie Wood; and daughter Poppy (b. 1984) with third wife, authoress Julia Gregson.
It was stated in the documentary "Natalie Wood: What Remains Behind," that the reason his and Natalie's marriage broke up was because of his affair with her personal assistant.