Has three children: son Filip Zivojinovic (b. 1985) with former partner Zorica Nakic (nee Desnica) and sons Stefan Zivojinovic (b. 21 May 1992) and Viktor Zivojinovic (b. 30 March 1998) with wife Lepa Brena.
On 23 November 2000, his son Stefan was kidnapped by members of the Zemun mafia. After they paid a ransom of 2,500,000 Deutsche Marks in cash, he was released, having been held for five days.