Skip to content
Eval Suites50

MedQA (USMLE)

Multiple-choice questions from medical licensing exams, testing clinical knowledge and diagnostic reasoning.

MedQA (USMLE) at a glance

Maintainer
Di Jin and MedQA authors
Size
12,723 English questions[1]
Category
Domain: Finance / Health / Legal
Runs with
Python
License
Not stated by the source. Check before commercial use.
Tier
starter

Failure modes MedQA (USMLE) catches

Diagnostic errors
Knowledge gaps

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

MedQA (USMLE) starter
git clone https://github.com/jind11/MedQA
# follow the repo README for setup and run commands

Sources

  1. 1. MedQA (USMLE) official page or repository · Di Jin and MedQA authors · Repository · Sources checked
  2. 2. MedQA (USMLE) paper · arXiv · Paper · Sources checked