Clinical Benchmarks

NVIDIA Nemotron 3 Ultra 550B A55B

Released 4 Jun 20261M context550B A55BopenAlso written as Nemotron 3 Ultra 256K, NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16

1 result on 1 of 13 boards, latest measured Jul 2026. Compare with other models

Results

Each line sits on its own board's scale. Tall tick: the board leader.

EHR and workflow agents

  1. CHI-Bench
    Listed as openai-agents + Nemotron 3 Ultra 256K
    All Domains pass@1; openai-agents; Tinker 256K
    0.0
    Rank 43 of 43 here, 45 models on the boardLeader erius + claude-opus-5 54.7
    Official leaderboard
    Measured Jul 2026

Sources

The quote, page and document for each of the 1 result
  1. 43CHI-Bench All Domains pass@1 0.0
    Printed as 0.0%Official leaderboard, measured Jul 2026Configuration: All Domains pass@1; openai-agents; Tinker 256K
    CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 44, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T22:31:29.302007Z to 2026-07-22T23:37:41.111758Z; submitted_at 2026-08-12T20:20:00Z.
    44 | openai-agents | Nemotron 3 Ultra 256K | Open-source | 0.0% | 0.0% | 0.0% | 0.0% | 2026-07-24
    Every result from this document

Other NVIDIA models: Nemotron 3.5 Lightning, Nemotron 3 Ultra