In the late '50s and '60s he was involved in several legal controversies. In 1959, he agreed to pay a settlement of $176,000 to an 81 year old widow who alleged he had romanced her out of her fortune. In 1965, he gave up a position on the Louisiana Tourist Development Commission amid allegations of improprieties.