Warhol veteran Joe Dallesandro was originally cast in the role of Stanley Sweetheart. Dallesandro was fired when he would consistently arrive on the set late and cause trouble with the cast and crew. Ironically, Andy Warhol himself later referred to the film as "the quintessential, most truthful studio-made film about the '60s counterculture".
The New York Times reported in October 1969 that 'Sweetheart' had been cast with Ultra Violet, Candy Darling, Gerard Malanga, and was to feature Andy Warhol in his very first Hollywood film role, that of a "freaked-out psychiatrist." This obviously didn't happen.