Clinical Benchmarks
Menu

DeepSeek-V3.1

Released 21 Aug 2025128K context671B A37Bopen

1 result on 1 of 13 boards, latest measured Jun 2026. Compare with other models

Clinical Benchmarks Index22.8Rank 101 of 1491 of 10 boardsAverage × multiplier 56.0 × 0.408 = 22.8This site’s own calculation. Working How it is computed

Results

Each line sits on its own board's scale. Tall tick: the board leader.

EHR and workflow agents

  1. EHR-Complex
    Table 3; macro-average across 12 intent/scope columns; temperature 0; up to 50 SQL/Python interaction turns
    0.560
    Rank 7 of 18Leader GPT-5.4 (high reasoning) 0.650
    Official leaderboard
    Measured Jun 2026

Index working

The Clinical Benchmarks Index is this site's own calculation: a weighted average of the board scores times a multiplier for the boards behind it. How it is computed

  • EHR-Complex0.56056.0×0.875Table 3; macro-average across 12 intent/scope columns; temperature 0; up to 50 SQL/Python interaction turns
One board, so its score
56.0
Multiplier for 1 of 10 boards
× 0.408
Index
56.0 × 0.408 = 22.8

Score: the result on the board’s own 0 to 100 scale. Dot: this model; tick: the board’s leader. Weight: how much the board counts in the weighted average. Each result links to its quote and page; the line under it is the setting it was measured with.

Sources

The quote, page and document for each of the 1 result
  1. 7EHR-Complex Table 3 0.560
    Printed as 0.56Official leaderboard, measured Jun 2026Configuration: Table 3; macro-average across 12 intent/scope columns; temperature 0; up to 50 SQL/Python interaction turns
    EHR-Complex: Benchmarking Medical Agents for Complex Clinical Reasoning (arXiv 2606.23301v1 PDF) paper, Zhejiang University / Ant Group (Qiao, Liu, Chu et al.), 22 Jun 2026. arXiv HTML 2606.23301v1, Table 3, DeepSeek-V3.1 row, final Avg. column (PDF p. 6).
    Model | Demographics | Vitals | Medications | Cost | Labs | Diagnoses | Avg. DeepSeek-V3.1 | 0.81 | 0.33 | 0.7 | 0.27 | 0.65 | 0.24 | 0.89 | 0.68 | 0.82 | 0.39 | 0.72 | 0.21 | 0.56
    Every result from this document

Other DeepSeek models: DeepSeek R1, DeepSeek-V3.2-Exp, DeepSeek V4.1 Flash, DeepSeek V4 Flash, DeepSeek V4 Flash 0731, DeepSeek V4 Pro