During filming, Cary Grant's wife, Betsy Drake, had him visiting a hypnotist to help him quit smoking. She also packed him a hamper full of health food for his lunch, though he often finished it before starting filming because without cigarettes he was hungry all the time.
During filming cinematographer Milton R. Krasner pointed out to Cary Grant that a lump on his forehead was making it hard to film his close-ups. The lump was the result of a childhood accident, but Grant had been habitually rubbing it for years, leading it to swell. Doctors told him it would take four to six weeks for him to recover from its removal. Instead, he took a few days off, had his wife, Betsy Drake, hypnotize him, and had the procedure performed in the doctor's office under a local anesthetic. He recovered within days with no scarring.
The film was shot mostly in Hollywood, though there were location shoots in New York City and the South of France. When Cathleen Nesbitt's friends asked if she had enjoyed filming her scene as Cary Grant's grandmother in France, she had to inform them that the interior scenes had been done on the 20th-Century-Fox back lot.
In the "50th anniversary" DVD release, one of the bonus features is a Movietone News piece about the shipboard premiere of the movie aboard the S.S. Constitution, identified in the newsreel as the location for filming.
Shortly after arriving in Villefranche, as they are traveling up a hill, seen in the background the USS Des Moines, CA-134, the flagship for the Commander of the Sixth Fleet of the U.S. Navy, which was home ported in Villefranche. Villefranche was the home port for COMSIXTHFLT from 1948 until 1967, when President De Gaulle removed all NATO troops from France.
The television show, "House to House" hosted by Robert Q. Lewis is an obvious parody of Person to Person (1953) hosted by Edward R. Murrow. The popular show aired from 1953 to 1961 and was at the height of its run when An Affair to Remember was released.
After the confrontation with the photographer on the ship's deck, Deborah Kerr turns to Cary Grant and says, "So, I go my way [traces a straight path by her hand] and you go yours [traces a twisty path with the wave of her hand]." The same exchange takes place between Irene Dunne and Cary Grant in The Awful Truth (1937), where she says, "As we go down the life's highway, you go in your way [traces a twisty path with the wave of her hand] and I go in my way [traces a straight path]."