CHI-Bench
Long-horizon healthcare operations workflows for agents: prior authorization, utilization management, and care management.
actAVA43 rows25 of 45 models on the boardmeasured to Aug 2026
Official page
More about this boardLess
Long-horizon healthcare operations workflows for agents: prior authorization, utilization management, and care management.
Long-horizon US healthcare operations workflows for agents (prior authorization, utilization management, care management), 60-80 step tasks across 4-6 stages, judged by deterministic unit tests plus an LLM judge for evidence grounding, consent, and cross-stage consistency.
Released May 20, 2026; updated August 12, 2026 across 45 harness configurations. The launch report led with reliability, not capability: no agent stayed above 20 percent across three identical runs. Harness choice matters as much as model choice, and the board accepts community submissions, so rows mix author-run and submitted results.
Published by actAVA.ai, released May 2026. 75 workflows (25 per domain), 21 healthcare applications, 200+ MCP tools. Pass@1 with binary 0/1 reward, higher better.
- Headline metric
- pass@1 accuracy, 75 tasks (25 each: prior authorization, utilization management, care management)
- Rows on the board
- 45
- Board last updated
- 12 Aug 2026
- Board version
- CHI-Bench v1.0.0
Ranking
- Printed as 54.7%Independent run, measured Aug 2026Configuration: community-submitted harness config validated by automated workspace judgeCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 01, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-26; accessed 2026-09-30.
01 | erius submitted by Michael Johnson (MJ) | claude-opus-5 | Proprietary | 54.7% | 72.0% | 36.0% | 56.0% | 2026-07-26
Every result from this document- Also printed in CHI-Bench submission manifest: erius + anthropic/claude-opus-5, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 37.3%Official leaderboard, measured Jul 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 03, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-24T19:08:02Z to 2026-07-24T23:22:36Z; submitted_at 2026-08-12T20:20:00Z.
03 | claude-code | claude-opus-5 | Proprietary | 37.3% | 20.0% | 32.0% | 60.0% | 2026-07-24
Every result from this document- Also printed in CHI-Bench submission manifest: claude-code + anthropic/claude-opus-5, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 37.3%Independent run, measured Aug 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 02, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-06-05; accessed 2026-09-30.
02 | erius submitted by Michael Johnson (MJ) | claude-opus-4-8 | Proprietary | 37.3% | 40.0% | 16.0% | 56.0% | 2026-06-05
Every result from this document- Also printed in CHI-Bench submission manifest: erius + anthropic/claude-opus-4-8, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 33.3%Official leaderboard, measured May 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 04, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-28; accessed 2026-09-30. Linked submission provenance: run 2026-05-28T17:19:15Z to 2026-05-28T20:48:59Z; submitted_at 2026-05-28T20:53:26Z.
04 | claude-code | claude-opus-4-8 | Proprietary | 33.3% | 32.0% | 28.0% | 40.0% | 2026-05-28
Every result from this document- Also printed in CHI-Bench submission manifest: claude-code + anthropic/claude-opus-4-8, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 28.0%Official leaderboard, measured May 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 05, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-12T18:55:45Z to 2026-05-12T18:55:46Z; submitted_at 2026-05-12T22:39:33Z.
05 | claude-code | claude-opus-4-6 | Proprietary | 28.0% | 20.0% | 36.0% | 28.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: claude-code + anthropic/claude-opus-4-6, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 26.2%Official leaderboard, measured Apr 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 06, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-04-29T14:43:27Z to 2026-04-30T15:00:19Z; submitted_at 2026-04-30T15:00:19Z.
06 | claude-code | claude-sonnet-4-6 | Proprietary | 26.2% | 24.0% | 34.7% | 20.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: claude-code + anthropic/claude-sonnet-4-6, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 25.3%Official leaderboard, measured Jul 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 07, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T02:41:32.718905Z to 2026-07-22T04:52:39.419746Z; submitted_at 2026-07-24T23:01:25Z.
07 | codex | gpt-5.6-sol | Proprietary | 25.3% | 36.0% | 28.0% | 12.0% | 2026-07-24
Every result from this document- Also printed in CHI-Bench submission manifest: codex + openai/gpt-5.6-sol, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 25.3%Official leaderboard, measured Jul 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 08, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T08:03:23.788878Z to 2026-07-22T14:22:38.269923Z; submitted_at 2026-08-12T20:20:00Z.
08 | openai-agents | kimi-k3 | Open-source | 25.3% | 28.0% | 32.0% | 16.0% | 2026-07-24
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + moonshotai/kimi-k3, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 24.4%Official leaderboard, measured Apr 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 09, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-04-29T06:06:32Z to 2026-04-30T10:00:03Z; submitted_at 2026-04-30T10:00:03Z.
09 | claude-code | claude-opus-4-7 | Proprietary | 24.4% | 24.0% | 17.3% | 32.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: claude-code + anthropic/claude-opus-4-7, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 24.0%Official leaderboard, measured Jul 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 10, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-22; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T07:16:27.207645Z to 2026-07-22T10:25:29.658582Z; submitted_at 2026-07-22T23:50:25Z.
10 | claude-code | claude-fable-5 | Proprietary | 24.0% | 24.0% | 24.0% | 24.0% | 2026-07-22
Every result from this document- Also printed in CHI-Bench submission manifest: claude-code + anthropic/claude-fable-5, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
All 43 rowsTop 10 only
- Printed as 22.7%Independent run, measured Jul 2026Configuration: All Domains pass@1; hermes harness; community submissionCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 11, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-06; accessed 2026-09-30. Linked submission provenance: run 2026-07-01T06:59:37Z to 2026-07-01T08:17:44Z; submitted_at 2026-07-06T09:10:18Z.
11 | hermes submitted by cuilinke | MedGuard | Open-source | 22.7% | 4.0% | 4.0% | 60.0% | 2026-07-06
Every result from this document- Also printed in CHI-Bench submission manifest: hermes + MedGuard, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 20.9%Official leaderboard, measured Apr 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 12, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-04-29T06:06:32Z to 2026-04-30T09:41:04Z; submitted_at 2026-04-30T09:41:04Z.
12 | codex | gpt-5.5 | Proprietary | 20.9% | 29.3% | 32.0% | 1.3% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: codex + openai/gpt-5.5, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 20.0%Official leaderboard, measured Jul 2026CHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 13, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-06; accessed 2026-09-30. Linked submission provenance: run 2026-07-02T04:22:04Z to 2026-07-02T04:31:46Z; submitted_at 2026-07-06T05:23:12Z.
13 | claude-code | claude-sonnet-5 | Proprietary | 20.0% | 24.0% | 24.0% | 12.0% | 2026-07-06
Every result from this document- Also printed in CHI-Bench submission manifest: claude-code + anthropic/claude-sonnet-5, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 18.7%Official leaderboard, measured May 2026Configuration: All Domains pass@1; hermes harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 15, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T07:01:48Z to 2026-05-04T05:47:30Z; submitted_at 2026-05-04T05:47:30Z.
15 | hermes | glm-5.1 | Open-source | 18.7% | 10.7% | 34.7% | 10.7% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: hermes + openrouter/z-ai/glm-5.1, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 18.7%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openai-agents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 14, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T08:41:54Z to 2026-05-04T07:03:18Z; submitted_at 2026-05-04T07:03:18Z.
14 | openai-agents | glm-5.1 | Open-source | 18.7% | 18.7% | 33.3% | 4.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + z-ai/glm-5.1, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 18.7%Official leaderboard, measured Jul 2026Configuration: All Domains pass@1; openai-agents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 16, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-06; accessed 2026-09-30. Linked submission provenance: run 2026-07-02T04:22:04Z to 2026-07-02T04:48:05Z; submitted_at 2026-07-06T05:23:05Z.
16 | openai-agents | glm-5.2 | Open-source | 18.7% | 20.0% | 32.0% | 4.0% | 2026-07-06
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + z-ai/glm-5.2, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 17.3%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openclaw harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 17, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-04T13:50:05Z to 2026-05-04T15:47:22Z; submitted_at 2026-05-04T15:47:22Z.
17 | openclaw | claude-opus-4-7 | Proprietary | 17.3% | 18.7% | 13.3% | 20.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openclaw + anthropic/claude-opus-4-7, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 16.9%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openclaw harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 18, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-02T09:10:57Z to 2026-05-04T02:49:29Z; submitted_at 2026-05-04T02:49:29Z.
18 | openclaw | glm-5.1 | Open-source | 16.9% | 13.3% | 26.7% | 10.7% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openclaw + openrouter/z-ai/glm-5.1, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 16.4%Official leaderboard, measured May 2026Configuration: All Domains pass@1; hermes harness; Qwen3.6-Max preview endpointCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 19, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T07:32:36Z to 2026-05-04T06:18:19Z; submitted_at 2026-05-04T06:18:19Z.
19 | hermes | qwen-3.6-max | Open-source | 16.4% | 9.3% | 26.7% | 13.3% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: hermes + openrouter/qwen/qwen3-6-max-preview, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 16.0%Official leaderboard, measured Apr 2026Configuration: All Domains pass@1; codex harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 20, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-04-29T19:36:29Z to 2026-04-30T22:58:31Z; submitted_at 2026-04-30T22:58:31Z.
20 | codex | gpt-5.4 | Proprietary | 16.0% | 24.0% | 17.3% | 6.7% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: codex + openai/gpt-5.4, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 15.6%Official leaderboard, measured May 2026Configuration: All Domains pass@1; hermes harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 22, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T07:19:12Z to 2026-05-04T06:35:44Z; submitted_at 2026-05-04T06:35:44Z.
22 | hermes | kimi-k2.6 | Open-source | 15.6% | 18.7% | 21.3% | 6.7% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: hermes + openrouter/moonshotai/kimi-k2.6, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 15.6%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openai-agents harness; Qwen3.6-Max preview endpointCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 21, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T09:19:32Z to 2026-05-04T07:25:50Z; submitted_at 2026-05-04T07:25:50Z.
21 | openai-agents | qwen-3.6-max | Open-source | 15.6% | 16.0% | 26.7% | 4.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + qwen/qwen3-6-max-preview, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 15.1%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openai-agents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 23, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T09:00:39Z to 2026-05-04T07:47:06Z; submitted_at 2026-05-04T07:47:06Z.
23 | openai-agents | kimi-k2.6 | Open-source | 15.1% | 17.3% | 25.3% | 2.7% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + moonshotai/kimi-k2.6, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 14.2%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openai-agents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 24, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T08:35:38Z to 2026-05-04T06:59:15Z; submitted_at 2026-05-04T06:59:15Z.
24 | openai-agents | deepseek-v4-pro | Open-source | 14.2% | 10.7% | 28.0% | 4.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + deepseek/deepseek-v4-pro, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 13.8%Official leaderboard, measured May 2026Configuration: All Domains pass@1; hermes harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 25, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T06:28:45Z to 2026-05-04T05:51:44Z; submitted_at 2026-05-04T05:51:44Z.
25 | hermes | deepseek-v4-pro | Open-source | 13.8% | 8.0% | 25.3% | 8.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: hermes + openrouter/deepseek/deepseek-v4-pro, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 13.3%Official leaderboard, measured Jul 2026Configuration: All Domains pass@1; codex harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 27, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T06:23:21.720425Z to 2026-07-22T08:02:34.258993Z; submitted_at 2026-07-24T23:01:25Z.
27 | codex | gpt-5.6-luna | Proprietary | 13.3% | 20.0% | 16.0% | 4.0% | 2026-07-24
Every result from this document- Also printed in CHI-Bench submission manifest: codex + openai/gpt-5.6-luna, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 13.3%Official leaderboard, measured Jul 2026Configuration: All Domains pass@1; codex harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 26, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T04:52:42.763467Z to 2026-07-22T06:23:17.742720Z; submitted_at 2026-07-24T23:01:25Z.
26 | codex | gpt-5.6-terra | Proprietary | 13.3% | 12.0% | 20.0% | 8.0% | 2026-07-24
Every result from this document- Also printed in CHI-Bench submission manifest: codex + openai/gpt-5.6-terra, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 12.5%Official leaderboard, measured Apr 2026Configuration: All Domains pass@1; gemini-cli harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 28, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-04-30T09:24:38Z to 2026-04-30T20:11:40Z; submitted_at 2026-04-30T20:11:40Z.
28 | gemini-cli | gemini-3-flash | Proprietary | 12.5% | 18.7% | 18.7% | 0.0% | 2026-05-01
Every result from this document- A different number in CHI-Bench submission manifest: gemini-cli + google/gemini-3-flash-preview, results.overall.pass_at_1 for submission.model google/gemini-3-flash-preview; fraction scale (not percent); retrieved 2026-09-30
- Printed as 11.1%Official leaderboard, measured May 2026Configuration: All Domains pass@1; deepagents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 30, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T21:51:53Z to 2026-05-04T13:10:34Z; submitted_at 2026-05-04T13:10:34Z.
30 | deepagents | glm-5.1 | Open-source | 11.1% | 17.3% | 10.7% | 5.3% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: deepagents + openrouter/z-ai/glm-5.1, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 11.1%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openclaw harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 29, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-02T09:01:51Z to 2026-05-04T03:00:01Z; submitted_at 2026-05-04T03:00:01Z.
29 | openclaw | deepseek-v4-pro | Open-source | 11.1% | 14.7% | 12.0% | 6.7% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openclaw + openrouter/deepseek/deepseek-v4-pro, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 10.7%Official leaderboard, measured May 2026Configuration: All Domains pass@1; deepagents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 31, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T07:35:56Z to 2026-05-05T01:34:20Z; submitted_at 2026-05-05T01:34:20Z.
31 | deepagents | deepseek-v4-pro | Open-source | 10.7% | 14.7% | 10.7% | 6.7% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: deepagents + openrouter/deepseek/deepseek-v4-pro, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 10.2%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openclaw harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 32, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T06:28:45Z to 2026-05-04T05:50:33Z; submitted_at 2026-05-04T05:50:33Z.
32 | openclaw | kimi-k2.6 | Open-source | 10.2% | 12.0% | 18.7% | 0.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openclaw + openrouter/moonshotai/kimi-k2.6, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 9.3%Official leaderboard, measured May 2026Configuration: All Domains pass@1; deepagents harness; Qwen3.6-Max preview endpointCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 33, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T22:18:28Z to 2026-05-04T13:19:53Z; submitted_at 2026-05-04T13:19:53Z.
33 | deepagents | qwen-3.6-max | Open-source | 9.3% | 12.0% | 10.7% | 5.3% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: deepagents + openrouter/qwen/qwen3-6-max-preview, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 8.4%Official leaderboard, measured May 2026Configuration: All Domains pass@1; codex harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 34, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-04-29T19:36:29Z to 2026-05-01T03:47:25Z; submitted_at 2026-05-01T03:47:25Z.
34 | codex | gpt-5.4-mini | Proprietary | 8.4% | 10.7% | 13.3% | 1.3% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: codex + openai/gpt-5.4-mini, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 8.0%Official leaderboard, measured Jul 2026Configuration: All Domains pass@1; openai-agents; Tinker 256K, high reasoning, 50-turn limitCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 35, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T14:25:50.976659Z to 2026-07-22T16:53:02.466832Z; submitted_at 2026-07-24T23:02:07Z.
35 | openai-agents | TML Inkling 256K | Open-source | 8.0% | 4.0% | 16.0% | 4.0% | 2026-07-24
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + thinkingmachines/Inkling:peft:262144, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 6.2%Official leaderboard, measured Apr 2026Configuration: All Domains pass@1; claude-code harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 37, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-04-29T19:36:29Z to 2026-04-30T19:34:41Z; submitted_at 2026-04-30T19:34:41Z.
37 | claude-code | claude-haiku-4-5 | Proprietary | 6.2% | 0.0% | 14.7% | 4.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: claude-code + anthropic/claude-haiku-4-5, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 5.8%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openai-agents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 38, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T09:26:38Z to 2026-05-04T07:18:48Z; submitted_at 2026-05-04T07:18:48Z.
38 | openai-agents | grok-4.3 | Open-source | 5.8% | 0.0% | 16.0% | 1.3% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + x-ai/grok-4.3, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 4.9%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openclaw harness; Qwen3.6-Max preview endpointCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 39, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-02T09:26:43Z to 2026-05-04T03:15:50Z; submitted_at 2026-05-04T03:15:50Z.
39 | openclaw | qwen-3.6-max | Open-source | 4.9% | 10.7% | 4.0% | 0.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openclaw + openrouter/qwen/qwen3-6-max-preview, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 4.4%Official leaderboard, measured May 2026Configuration: All Domains pass@1; hermes harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 40, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T07:34:26Z to 2026-05-04T06:20:37Z; submitted_at 2026-05-04T06:20:37Z.
40 | hermes | grok-4.3 | Open-source | 4.4% | 0.0% | 13.3% | 0.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: hermes + openrouter/x-ai/grok-4.3, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 3.1%Official leaderboard, measured May 2026Configuration: All Domains pass@1; deepagents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 41, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T21:58:07Z to 2026-05-04T13:39:21Z; submitted_at 2026-05-04T13:39:21Z.
41 | deepagents | kimi-k2.6 | Open-source | 3.1% | 8.0% | 1.3% | 0.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: deepagents + openrouter/moonshotai/kimi-k2.6, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 2.2%Official leaderboard, measured May 2026Configuration: All Domains pass@1; deepagents harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 42, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-03T22:19:46Z to 2026-05-04T13:19:20Z; submitted_at 2026-05-04T13:19:20Z.
42 | deepagents | grok-4.3 | Open-source | 2.2% | 0.0% | 5.3% | 1.3% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: deepagents + openrouter/x-ai/grok-4.3, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 0.4%Official leaderboard, measured May 2026Configuration: All Domains pass@1; openclaw harnessCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 43, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-05-01; accessed 2026-09-30. Linked submission provenance: run 2026-05-02T09:34:46Z to 2026-05-04T00:03:58Z; submitted_at 2026-05-04T00:03:58Z.
43 | openclaw | grok-4.3 | Open-source | 0.4% | 1.3% | 0.0% | 0.0% | 2026-05-01
Every result from this document- Also printed in CHI-Bench submission manifest: openclaw + openrouter/x-ai/grok-4.3, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
- Printed as 0.0%Official leaderboard, measured Jul 2026Configuration: All Domains pass@1; openai-agents; Tinker 256KCHI-Bench leaderboard (actAVA) official leaderboard, actAVA, 12 Aug 2026. CHI-Bench v1.0.0, All Domains, rank 44, Agent/Model and Accuracy columns; PA/UM/CM follow; board last updated 2026-08-12; board Date column 2026-07-24; accessed 2026-09-30. Linked submission provenance: run 2026-07-22T22:31:29.302007Z to 2026-07-22T23:37:41.111758Z; submitted_at 2026-08-12T20:20:00Z.
44 | openai-agents | Nemotron 3 Ultra 256K | Open-source | 0.0% | 0.0% | 0.0% | 0.0% | 2026-07-24
Every result from this document- Also printed in CHI-Bench submission manifest: openai-agents + nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16:peft:262144, submission.model; provenance.started_at / finished_at; results.overall.pass_at_1; retrieved 2026-09-30
No rows match. Turn a reported-by option back on or clear the chosen models.
Pass@1 with binary 0/1 reward, higher better. Bar colour: the lab; a pale bar with an outline is a number the model’s own lab reported. Select a row for its quote, page and document.
| Rank | Model | Lab | Score | Configuration | Reported by | Measured | Source |
|---|---|---|---|---|---|---|---|
| 1 | erius + claude-opus-5 | Humana (harness) / Anthropic (model) | 54.7 | community-submitted harness config validated by automated workspace judge | Independent run | Aug 2026 | Quote and page |
| 2 | claude-code + claude-opus-5 | Anthropic | 37.3 | Official leaderboard | Jul 2026 | Quote and page | |
| 2 | erius + claude-opus-4-8 | Humana / Anthropic | 37.3 | Independent run | Aug 2026 | Quote and page | |
| 4 | claude-code + claude-opus-4-8 | Anthropic | 33.3 | Official leaderboard | May 2026 | Quote and page | |
| 5 | claude-code + claude-opus-4-6 | Anthropic | 28.0 | Official leaderboard | May 2026 | Quote and page | |
| 6 | claude-code + claude-sonnet-4-6 | Anthropic | 26.2 | Official leaderboard | Apr 2026 | Quote and page | |
| 7 | codex + gpt-5.6-sol | OpenAI | 25.3 | Official leaderboard | Jul 2026 | Quote and page | |
| 7 | openai-agents + kimi-k3 | Moonshot AI | 25.3 | Official leaderboard | Jul 2026 | Quote and page | |
| 9 | claude-code + claude-opus-4-7 | Anthropic | 24.4 | Official leaderboard | Apr 2026 | Quote and page | |
| 10 | claude-code + claude-fable-5 | Anthropic | 24.0 | Official leaderboard | Jul 2026 | Quote and page | |
| 11 | hermes + MedGuard | MedGuard | 22.7 | All Domains pass@1; hermes harness; community submission | Independent run | Jul 2026 | Quote and page |
| 12 | codex + gpt-5.5 | OpenAI | 20.9 | Official leaderboard | Apr 2026 | Quote and page | |
| 13 | claude-code + claude-sonnet-5 | Anthropic | 20.0 | Official leaderboard | Jul 2026 | Quote and page | |
| 14 | hermes + glm-5.1 | Zhipu | 18.7 | All Domains pass@1; hermes harness | Official leaderboard | May 2026 | Quote and page |
| 14 | openai-agents + glm-5.1 | Zhipu | 18.7 | All Domains pass@1; openai-agents harness | Official leaderboard | May 2026 | Quote and page |
| 14 | openai-agents + glm-5.2 | Zhipu | 18.7 | All Domains pass@1; openai-agents harness | Official leaderboard | Jul 2026 | Quote and page |
| 17 | openclaw + claude-opus-4-7 | Anthropic | 17.3 | All Domains pass@1; openclaw harness | Official leaderboard | May 2026 | Quote and page |
| 18 | openclaw + glm-5.1 | Zhipu | 16.9 | All Domains pass@1; openclaw harness | Official leaderboard | May 2026 | Quote and page |
| 19 | hermes + qwen-3.6-max | Alibaba | 16.4 | All Domains pass@1; hermes harness; Qwen3.6-Max preview endpoint | Official leaderboard | May 2026 | Quote and page |
| 20 | codex + gpt-5.4 | OpenAI | 16.0 | All Domains pass@1; codex harness | Official leaderboard | Apr 2026 | Quote and page |
| 21 | hermes + kimi-k2.6 | Moonshot AI | 15.6 | All Domains pass@1; hermes harness | Official leaderboard | May 2026 | Quote and page |
| 21 | openai-agents + qwen-3.6-max | Alibaba | 15.6 | All Domains pass@1; openai-agents harness; Qwen3.6-Max preview endpoint | Official leaderboard | May 2026 | Quote and page |
| 23 | openai-agents + kimi-k2.6 | Moonshot AI | 15.1 | All Domains pass@1; openai-agents harness | Official leaderboard | May 2026 | Quote and page |
| 24 | openai-agents + deepseek-v4-pro | DeepSeek | 14.2 | All Domains pass@1; openai-agents harness | Official leaderboard | May 2026 | Quote and page |
| 25 | hermes + deepseek-v4-pro | DeepSeek | 13.8 | All Domains pass@1; hermes harness | Official leaderboard | May 2026 | Quote and page |
| 26 | codex + gpt-5.6-luna | OpenAI | 13.3 | All Domains pass@1; codex harness | Official leaderboard | Jul 2026 | Quote and page |
| 26 | codex + gpt-5.6-terra | OpenAI | 13.3 | All Domains pass@1; codex harness | Official leaderboard | Jul 2026 | Quote and page |
| 28 | gemini-cli + gemini-3-flash | 12.5 | All Domains pass@1; gemini-cli harness | Official leaderboard | Apr 2026 | Quote and page | |
| 29 | deepagents + glm-5.1 | Zhipu | 11.1 | All Domains pass@1; deepagents harness | Official leaderboard | May 2026 | Quote and page |
| 29 | openclaw + deepseek-v4-pro | DeepSeek | 11.1 | All Domains pass@1; openclaw harness | Official leaderboard | May 2026 | Quote and page |
| 31 | deepagents + deepseek-v4-pro | DeepSeek | 10.7 | All Domains pass@1; deepagents harness | Official leaderboard | May 2026 | Quote and page |
| 32 | openclaw + kimi-k2.6 | Moonshot AI | 10.2 | All Domains pass@1; openclaw harness | Official leaderboard | May 2026 | Quote and page |
| 33 | deepagents + qwen-3.6-max | Alibaba | 9.3 | All Domains pass@1; deepagents harness; Qwen3.6-Max preview endpoint | Official leaderboard | May 2026 | Quote and page |
| 34 | codex + gpt-5.4-mini | OpenAI | 8.4 | All Domains pass@1; codex harness | Official leaderboard | May 2026 | Quote and page |
| 35 | openai-agents + TML Inkling 256K | Thinking Machines | 8.0 | All Domains pass@1; openai-agents; Tinker 256K, high reasoning, 50-turn limit | Official leaderboard | Jul 2026 | Quote and page |
| 36 | claude-code + claude-haiku-4-5 | Anthropic | 6.2 | All Domains pass@1; claude-code harness | Official leaderboard | Apr 2026 | Quote and page |
| 37 | openai-agents + grok-4.3 | SpaceX AI | 5.8 | All Domains pass@1; openai-agents harness | Official leaderboard | May 2026 | Quote and page |
| 38 | openclaw + qwen-3.6-max | Alibaba | 4.9 | All Domains pass@1; openclaw harness; Qwen3.6-Max preview endpoint | Official leaderboard | May 2026 | Quote and page |
| 39 | hermes + grok-4.3 | SpaceX AI | 4.4 | All Domains pass@1; hermes harness | Official leaderboard | May 2026 | Quote and page |
| 40 | deepagents + kimi-k2.6 | Moonshot AI | 3.1 | All Domains pass@1; deepagents harness | Official leaderboard | May 2026 | Quote and page |
| 41 | deepagents + grok-4.3 | SpaceX AI | 2.2 | All Domains pass@1; deepagents harness | Official leaderboard | May 2026 | Quote and page |
| 42 | openclaw + grok-4.3 | SpaceX AI | 0.4 | All Domains pass@1; openclaw harness | Official leaderboard | May 2026 | Quote and page |
| 43 | openai-agents + Nemotron 3 Ultra 256K | NVIDIA | 0.0 | All Domains pass@1; openai-agents; Tinker 256K | Official leaderboard | Jul 2026 | Quote and page |
Documents
44 documents support this board
- CHI-Bench leaderboard (actAVA)official leaderboard, actAVA, 12 Aug 2026Results it supports
- CHI-Bench submission manifest: claude-code + anthropic/claude-fable-5official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: claude-code + anthropic/claude-haiku-4-5official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: claude-code + anthropic/claude-opus-4-6official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: claude-code + anthropic/claude-opus-4-7official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: claude-code + anthropic/claude-opus-4-8official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: claude-code + anthropic/claude-opus-5official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: claude-code + anthropic/claude-sonnet-4-6official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: claude-code + anthropic/claude-sonnet-5official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: codex + openai/gpt-5.4official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: codex + openai/gpt-5.4-miniofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: codex + openai/gpt-5.5official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: codex + openai/gpt-5.6-lunaofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: codex + openai/gpt-5.6-solofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: codex + openai/gpt-5.6-terraofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: deepagents + openrouter/deepseek/deepseek-v4-proofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: deepagents + openrouter/moonshotai/kimi-k2.6official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: deepagents + openrouter/qwen/qwen3-6-max-previewofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: deepagents + openrouter/x-ai/grok-4.3official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: deepagents + openrouter/z-ai/glm-5.1official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: erius + anthropic/claude-opus-4-8official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: erius + anthropic/claude-opus-5official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: gemini-cli + google/gemini-3-flash-previewofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: hermes + MedGuardofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: hermes + openrouter/deepseek/deepseek-v4-proofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: hermes + openrouter/moonshotai/kimi-k2.6official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: hermes + openrouter/qwen/qwen3-6-max-previewofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: hermes + openrouter/x-ai/grok-4.3official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: hermes + openrouter/z-ai/glm-5.1official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + deepseek/deepseek-v4-proofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + moonshotai/kimi-k2.6official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + moonshotai/kimi-k3official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16:peft:262144official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + qwen/qwen3-6-max-previewofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + thinkingmachines/Inkling:peft:262144official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + x-ai/grok-4.3official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + z-ai/glm-5.1official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openai-agents + z-ai/glm-5.2official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openclaw + anthropic/claude-opus-4-7official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openclaw + openrouter/deepseek/deepseek-v4-proofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openclaw + openrouter/moonshotai/kimi-k2.6official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openclaw + openrouter/qwen/qwen3-6-max-previewofficial leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openclaw + openrouter/x-ai/grok-4.3official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports
- CHI-Bench submission manifest: openclaw + openrouter/z-ai/glm-5.1official leaderboard, actAVA / CHI-Bench submission repositoryResults it supports