You can make your own decision. In Patton’s case, Jean Gordon his wife’s niece, was part of a Red Cross unit attached to Patton’s Third Army and accompanied his headquarters across France into Germany. Jean Gordon committed suicide in January 1946 shortly after Patton’s death. see the section on Dispute over the relationship with Patton in the Wikipedia entry for Jean Gordon.
Kay Summersby was Eisenhower’s driver, secretary and aide de camp during the war. She wrote a book after the war and after Eisenhower’s death called “Past Forgetting: My Love Affair with Dwight D. Eisenhower *available from Amazon Books.
General Everett Hughes a colleague of both Eisenhower and Patton in Europe made several entries in his diary about both Mrs Summersby and Ms. Gordon. See “Hughes’ War: The Allied High Command Through the Eyes of General Everett S. Hughes” by Alex Lovelace.