Questions
Short answers about the 13 boards and how to read them.
- Which model is best for clinical work?
- It depends on the job. Pick the board that matches it, such as documentation, coding or EHR agents, and read that board with the configuration line under each row. The index gives one ordering across boards, as this site's own summary, and the compare page sets two to four models side by side.
- How is the index different from a board?
- A board is one benchmark's own results, ranked on its own scale. The index is this site's calculation across boards: each result is read on its board's 0 to 100 scale, boards whose leader is already near 100 count for less, and a model's score is the weighted mean over its boards, scaled down below 6 boards. It is a summary; the boards are the evidence. How it is computed.
- Why does no model score near 100 on the index?
- Because no model scores near 100 on most clinical boards. Each result counts at its real value on its board's scale, not stretched so the board's leader reaches 100, and the boards with the most headroom carry the most weight. Right now MedScribe (Vals AI), MedXpertQA (MM) and MedPIC are near the ceiling.
- How does the index treat a model with results on one or two boards?
- Every model with a result on an index board is ranked, but a score from fewer boards rests on less evidence, so it is multiplied down: ×0.408 for one board, ×0.577 for two boards, ×0.707 for three boards, ×0.816 for four boards, ×0.913 for five boards, ×1 from six up. Claude Fable 5 has a weighted mean of 66.9 from 5 of 10 boards, so its index is 66.9 × 0.913 = 61.1. The pips under each entry show how many index boards a score rests on, and the index views can be filtered to models with results on 2, 3 or 5 or more boards.
- What do the bar colours mean?
- The colour is the lab that built the model, and the lab's mark sits beside the name. A pale bar with an outline is a number the model's own lab reported; a solid bar comes from the benchmark's leaderboard or an independent run.
- Why does the same model appear twice on one board?
- Because it was run twice under different settings, for example a different reasoning effort, harness or grader. Each row keeps its configuration, and neither is dropped.
- Why is a model's rank here different from the official board?
- This site may carry fewer rows than the official board. Where the full field size is known, the board page says how many of those models appear here.
- Can I use the data?
- Yes. The compilation is CC BY 4.0: credit Clinical Benchmarks and link back. Every result is downloadable as CSV or JSON.
- How do I report a wrong number?
- Use the contact link and name the document and page that shows the right value. Corrections go through the same check as any new row.
- Where are the consumer health benchmarks?
- Boards about AI people use for their own health are on the sister site linked at the foot of every page.