MedHELM

1. 1Gemini 3.1 Pro (Preview)Google0.652
   Printed as 0.652Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   1 Gemini 3.1 Pro (Preview) Google 0.652

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.6520833333333333, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

2. 2Gemini 3.5 FlashGoogle0.642
   Printed as 0.642Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   2 Gemini-3.5-flash Google 0.642

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.6416666666666667, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

3. 3Muse Spark (2026-04-08)Meta0.621
   Printed as 0.621Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   3 Muse Spark (2026-04-08) Meta 0.621

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.6208333333333333, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

4. 4GPT-5.4 miniOpenAI0.552
   Printed as 0.552Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   4 GPT-5.4 mini OpenAI 0.552

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.5520833333333334, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

5. 5GPT-5.4 (2026-03-05)OpenAI0.538
   Printed as 0.538Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   5 GPT-5.4 (2026-03-05) OpenAI 0.538

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.5375, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

6. 6Gemini 2.5 ProGoogle0.529
   Printed as 0.529Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   6 Gemini 2.5 Pro (05-06 preview) Google 0.529

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.5291666666666667, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

7. 7DEDeepSeek R1DeepSeek0.485
   Printed as 0.485Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   7 DeepSeek R1 DeepSeek 0.485

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.48541666666666666, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

8. 8Claude 4.6 OpusAnthropic0.456
   Printed as 0.456Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   8 Claude 4.6 Opus Anthropic 0.456

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.45625, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

9. 9Claude 3.7 SonnetAnthropic0.450
   Printed as 0.45Official leaderboard, measured May 2026

   MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

   9 Claude 3.7 Sonnet (20250219) Anthropic 0.45

   Every result from this document

   • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.45, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

   Link to this row

10. 10Gemini 2.0 FlashGoogle0.342
    Printed as 0.342Official leaderboard, measured May 2026

    MedHELM leaderboard (medhelm.org), v5.0.0 official leaderboard, Stanford CRFM (MedHELM), 14 May 2026. medhelm.org home, 'Current leaders Mean win rate v5.0.0' table ('10 of 11 models · Updated 14 May 2026')

    10 Gemini 2.0 Flash Google 0.342

    Every result from this document

    • Also printed in MedHELM v5.0.0 release data: medhelm_scenarios group table (mean win rate): 0.3416666666666667, releases/v5.0.0/groups/medhelm_scenarios.json, table 'Accuracy', column 'Mean win rate'

    Link to this row

No rows match. Turn a reported-by option back on or clear the chosen models.

Mean win rate 0-1, higher better. Bar colour: the lab; a pale bar with an outline is a number the model’s own lab reported. Select a row for its quote, page and document.