Clinical Benchmarks

MedGuard

Product

1 result on 1 of 13 boards, latest measured Jul 2026. Compare with other models

Results

Each line sits on its own board's scale. Tall tick: the board leader.

EHR and workflow agents

  1. CHI-Bench
    Listed as hermes + MedGuard
    All Domains pass@1; hermes harness; community submission
    22.7
    Rank 11 of 43 here, 45 models on the boardLeader erius + claude-opus-5 54.7
    Independent run
    Measured Jul 2026

Sources

The quote, page and document for each of the 1 result
  1. 11CHI-Bench All Domains pass@1 22.7
    Printed as 22.7%Independent run, measured Jul 2026Configuration: All Domains pass@1; hermes harness; community submission
    CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 11, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-06; accessed 2026-09-30. Linked submission provenance: run 2026-07-01T06:59:37Z to 2026-07-01T08:17:44Z; submitted_at 2026-07-06T09:10:18Z.
    11 | hermes submitted by cuilinke | MedGuard | Open-source | 22.7% | 4.0% | 4.0% | 60.0% | 2026-07-06
    Every result from this document