Clinical Benchmarks

DeepSeek

DeepSeek models with results here, each shown on its own board.

Models
7
Results
18
Boards
8 of 13

www.deepseek.com

Models

ModelKindReleasedBoards
DeepSeek V4.1 FlashModel10 Sep 20262
DeepSeek V4 Flash 0731Model31 Jul 20261
DeepSeek V4 FlashModel24 Apr 20261
DeepSeek V4 ProModel24 Apr 20265
DeepSeek-V3.2-ExpModel29 Sep 20251
DeepSeek-V3.1Model21 Aug 20251
DeepSeek R1Model20 Jan 20252

Results

One line per result. Tall tick: the board leader.

Clinical reasoning and knowledge

  1. 0.485
    Rank 7 of 10 here, 11 models on the boardLeader Gemini 3.1 Pro (Preview) 0.652
    Official leaderboard
    Measured May 2026

Documentation and coding

  1. MedScribe (Vals AI)
    model ID deepseek/deepseek-v4.1-flash; max_output_tokens=384000; reasoning_effort=high
    85.50
    Rank 24 of 105Leader Claude Opus 5.5 91.43
    Official leaderboard
    Measured Sep 2026
  2. MedScribe (Vals AI)
    model ID deepseek/deepseek-v4-flash-0731; max_output_tokens=30000; reasoning_effort=high
    80.36
    Rank 54 of 105Leader Claude Opus 5.5 91.43
    Official leaderboard
    Measured Sep 2026
  3. MedScribe (Vals AI)
    model ID deepseek/deepseek-v4-pro-0813; max_output_tokens=30000; reasoning_effort=max
    80.17
    Rank 55 of 105Leader Claude Opus 5.5 91.43
    Official leaderboard
    Measured Sep 2026
  4. MedScribe (Vals AI)
    model ID deepseek/deepseek-v4-pro; max_output_tokens=128000; reasoning_effort=max
    75.14
    Rank 77 of 105Leader Claude Opus 5.5 91.43
    Official leaderboard
    Measured Sep 2026
  5. MedCode (Vals AI)
    model ID deepseek/deepseek-v4-pro-0813; reasoning_effort=max; max_output_tokens=30000
    42.47
    Rank 47 of 103Leader Claude Opus 5 63.57
    Official leaderboard
    Measured Sep 2026
  6. MedCode (Vals AI)
    model ID deepseek/deepseek-v4-flash-0731; reasoning_effort=high; max_output_tokens=30000
    41.41
    Rank 50 of 103Leader Claude Opus 5 63.57
    Official leaderboard
    Measured Sep 2026
  7. MedCode (Vals AI)
    model ID deepseek/deepseek-v4.1-flash; reasoning_effort=high; max_output_tokens=384000
    41.17
    Rank 54 of 103Leader Claude Opus 5 63.57
    Official leaderboard
    Measured Sep 2026
  8. MedCode (Vals AI)
    model ID deepseek/deepseek-v4-pro; reasoning_effort=max; max_output_tokens=128000
    40.45
    Rank 61 of 103Leader Claude Opus 5 63.57
    Official leaderboard
    Measured Sep 2026

EHR and workflow agents

  1. PhysicianBench
    Pass@1 over 3 runs; Pass^3 6.0; shared FHIR tool harness; up to 100 turns; high reasoning when supported
    18.7
    Rank 20 of 28 here, 12 models on the boardLeader Claude Opus 5.5 (max) 68.4
    Official leaderboard
    Measured May 2026
  2. EHR-Complex
    Table 3; macro-average across 12 intent/scope columns; temperature 0; up to 50 SQL/Python interaction turns
    0.590
    Rank 5 of 18Leader GPT-5.4 (high reasoning) 0.650
    Official leaderboard
    Measured Jun 2026
  3. EHR-Complex
    Table 3; macro-average across 12 intent/scope columns; temperature 0; up to 50 SQL/Python interaction turns
    0.560
    Rank 7 of 18Leader GPT-5.4 (high reasoning) 0.650
    Official leaderboard
    Measured Jun 2026
  4. CHI-Bench
    All Domains pass@1; openai-agents harness
    14.2
    Rank 24 of 43 here, 45 models on the boardLeader erius + claude-opus-5 54.7
    Official leaderboard
    Measured May 2026
  5. CHI-Bench
    All Domains pass@1; hermes harness
    13.8
    Rank 25 of 43 here, 45 models on the boardLeader erius + claude-opus-5 54.7
    Official leaderboard
    Measured May 2026
  6. CHI-Bench
    All Domains pass@1; openclaw harness
    11.1
    Rank 29 of 43 here, 45 models on the boardLeader erius + claude-opus-5 54.7
    Official leaderboard
    Measured May 2026
  7. CHI-Bench
    All Domains pass@1; deepagents harness
    10.7
    Rank 31 of 43 here, 45 models on the boardLeader erius + claude-opus-5 54.7
    Official leaderboard
    Measured May 2026

Safety

  1. MedPIC
    zero-shot; independent questions; exact option-set match
    71.7
    Rank 4 of 28Leader Gemini-3.1-Pro 80.7
    Independent run
    Measured Aug 2026
  2. 55.8
    Rank 17 of 17 here, 19 models on the boardLeader LiSA 2.5 86.2
    Official leaderboard
    Measured Aug 2026