On May 5, 1954 — Baltimore Orioles pitcher Bob Turley gives up two hits to the New York Yankees but is defeated by his former teammates, 4 – 2. It is Turley’s second two-hit loss of the season; the Cleveland Indians defeated him on April 2nd.

Source:
Baseball Reference May 5