HealthAdminBench

1. 1Claude Opus 4.6 (computer-use agent)Anthropic · screenshot-only36.3
   Printed as 36.3%Official leaderboard, measured Apr 2026Configuration: screenshot-only, detailed prompting; native CUA harness; subtask rate 78.4%

   HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (arXiv 2604.09937v1) paper, Bedi, Welch, Steinberg et al. (Stanford University / Kinetic Systems / Stanford Health Care), 10 Apr 2026. p. 8, Figure 3(a), Task Success Rate, bar "Claude Opus 4.6 CUA"; section 4, p. 7 gives screenshot-only, Task Description + Portal Guidance; arXiv 2604.09937v1 dated 2026-04-10; checked 2026-09-30.

   Claude Opus 4.6 CUA | 36.3%

   Every result from this document

   • Also printed in Introducing HealthAdminBench: AI Agents Can Diagnose Rare Diseases, But Can They Handle Your Insurance? (Kinetic Systems blog): 36.3%, Section 'LLMs struggle with long-horizon tasks'

   Link to this row

2. 2GPT-5.4 (computer-use agent)OpenAI · screenshot-only26.7
   Printed as 26.7%Official leaderboard, measured Apr 2026Configuration: screenshot-only, detailed prompting; subtask rate 82.8%

   HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (arXiv 2604.09937v1) paper, Bedi, Welch, Steinberg et al. (Stanford University / Kinetic Systems / Stanford Health Care), 10 Apr 2026. p. 8, Figure 3(a), Task Success Rate, bar "GPT-5.4 CUA"; section 4, p. 7 gives screenshot-only, Task Description + Portal Guidance; arXiv 2604.09937v1 dated 2026-04-10; checked 2026-09-30.

   GPT-5.4 CUA | 26.7%

   Every result from this document

   • Also printed in Introducing HealthAdminBench: AI Agents Can Diagnose Rare Diseases, But Can They Handle Your Insurance? (Kinetic Systems blog): 26.7%, Section 'LLMs struggle with long-horizon tasks'

   Link to this row

3. 3Kimi K2.5Moonshot AI · screenshot-only15.6
   Printed as 15.6%Official leaderboard, measured Apr 2026Configuration: screenshot-only, detailed prompting

   HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (arXiv 2604.09937v1) paper, Bedi, Welch, Steinberg et al. (Stanford University / Kinetic Systems / Stanford Health Care), 10 Apr 2026. p. 8, Figure 3(a), Task Success Rate, bar "Kimi K2.5"; section 4, p. 7 gives screenshot-only, Task Description + Portal Guidance; arXiv 2604.09937v1 dated 2026-04-10; checked 2026-09-30.

   Kimi K2.5 | 15.6%

   Every result from this document

   • Also printed in Introducing HealthAdminBench: AI Agents Can Diagnose Rare Diseases, But Can They Handle Your Insurance? (Kinetic Systems blog): 15.6%, Section 'LLMs struggle with long-horizon tasks'

   Link to this row

4. 4Claude Opus 4.6 (standardized harness)Anthropic · screenshot-only14.8
   Printed as 14.8%Official leaderboard, measured Apr 2026Configuration: screenshot-only, detailed prompting; authors' standardized harness, no native CUA

   HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (arXiv 2604.09937v1) paper, Bedi, Welch, Steinberg et al. (Stanford University / Kinetic Systems / Stanford Health Care), 10 Apr 2026. p. 8, Figure 3(a), Task Success Rate, bar "Claude Opus 4.6"; section 4, p. 7 gives screenshot-only, Task Description + Portal Guidance; arXiv 2604.09937v1 dated 2026-04-10; checked 2026-09-30.

   Claude Opus 4.6 | 14.8%

   Every result from this document

   Link to this row

5. 5ALQwen 3.5Alibaba · screenshot-only13.3
   Printed as 13.3%Official leaderboard, measured Apr 2026Configuration: screenshot-only, detailed prompting

   HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (arXiv 2604.09937v1) paper, Bedi, Welch, Steinberg et al. (Stanford University / Kinetic Systems / Stanford Health Care), 10 Apr 2026. p. 8, Figure 3(a), Task Success Rate, bar "Qwen 3.5"; section 4, p. 7 gives screenshot-only, Task Description + Portal Guidance; arXiv 2604.09937v1 dated 2026-04-10; checked 2026-09-30.

   Qwen 3.5 | 13.3%

   Every result from this document

   • Also printed in Introducing HealthAdminBench: AI Agents Can Diagnose Rare Diseases, But Can They Handle Your Insurance? (Kinetic Systems blog): 13.3%, Section 'LLMs struggle with long-horizon tasks'

   Link to this row

6. 6Gemini 3.1 ProGoogle · screenshot-only11.9
   Printed as 11.9%Official leaderboard, measured Apr 2026Configuration: screenshot-only, detailed prompting

   HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (arXiv 2604.09937v1) paper, Bedi, Welch, Steinberg et al. (Stanford University / Kinetic Systems / Stanford Health Care), 10 Apr 2026. p. 8, Figure 3(a), Task Success Rate, bar "Gemini 3.1 Pro"; section 4, p. 7 gives screenshot-only, Task Description + Portal Guidance; arXiv 2604.09937v1 dated 2026-04-10; checked 2026-09-30.

   Gemini 3.1 Pro | 11.9%

   Every result from this document

   • Also printed in Introducing HealthAdminBench: AI Agents Can Diagnose Rare Diseases, But Can They Handle Your Insurance? (Kinetic Systems blog): 11.9%, Section 'LLMs struggle with long-horizon tasks'

   Link to this row

7. 7GPT-5.4 (standardized harness)OpenAI · screenshot-only5.9
   Printed as 5.9%Official leaderboard, measured Apr 2026Configuration: screenshot-only, detailed prompting; authors' standardized harness, no native CUA

   HealthAdminBench: Evaluating Computer-Use Agents on Healthcare Administration Tasks (arXiv 2604.09937v1) paper, Bedi, Welch, Steinberg et al. (Stanford University / Kinetic Systems / Stanford Health Care), 10 Apr 2026. p. 8, Figure 3(a), Task Success Rate, bar "GPT-5.4"; section 4, p. 7 gives screenshot-only, Task Description + Portal Guidance; arXiv 2604.09937v1 dated 2026-04-10; checked 2026-09-30.

   GPT-5.4 | 5.9%

   Every result from this document

   Link to this row

No rows match. Turn a reported-by option back on or clear the chosen models.

Percentage end-to-end task success 0-100, higher better. Bar colour: the lab; a pale bar with an outline is a number the model’s own lab reported. Select a row for its quote, page and document.