ChatGPT passed the USMLE exam for a US medical license.

February 15, 2023

It is noteworthy that the exam includes non-obvious questions that are almost impossible to google - you need to apply logic to answer. Over three attempts to pass the exam, ChatGPT scored between 52.4% and 75.0% of the scores. Passing score - 60%. It's funny that the PubMedGPT AI, trained exclusively on medical literature, was able to pass the exam by only 50.8%.