Qwen3.5-9B
256K context9Bopen
7 results on 1 of 13 boards, 6 of them on secondary measures, latest measured Aug 2026. Compare with other models
Results
Each line sits on its own board's scale. Tall tick: the board leader.
Safety
- MedPICzero-shot; independent questions; exact option-set match63.8Rank 10 of 28Leader Gemini-3.1-Pro 80.7
Index working
The Clinical Benchmarks Index is this site's own calculation: a weighted average of the board scores times a multiplier for the boards behind it. How it is computed
- MedPIC63.863.8×0.482, near its ceilingNear its ceiling: leader 80.7, weight 0.482zero-shot; independent questions; exact option-set match
- One board, so its score
- 63.8
- Multiplier for 1 of 10 boards
- × 0.408
- Index
- 63.8 × 0.408 = 26.0
Score: the result on the board’s own 0 to 100 scale. Dot: this model; tick: the board’s leader. Weight: how much the board counts in the weighted average; bold where the board is near its ceiling and counts for less. Each result links to its quote and page; the line under it is the setting it was measured with.
Secondary measures
Safety
- 47.1Rank 9 of 28Leader Gemini-3.1-Pro 77.9
- 73.9Rank 10 of 28Leader Gemini-3.1-Pro 87.7
- 24.7Rank 10 of 28Leader Gemini-3.1-Pro 48.3
- 48.1Rank 11 of 28Leader Gemini-3.1-Pro 69.9
- 54.9Rank 17 of 28Leader MedGemma-27B-Text 76.1
- 25.9Descriptive measure, not ranked
Sources
The quote, page and document for each of the 7 results
10MedPIC zero-shot 63.8
Printed as 63.8Independent run, measured Aug 2026Configuration: zero-shot; independent questions; exact option-set matchEvaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoning paper, Zhitian Hou, Yuhang Liu, Pengkai Wang, Zeyu Liu, Guanghao Zhu, Zheng Liu, Shuo Cai, Congkai Xie, Zhijie Sang, Kun Zeng, Hongxia Yang (The Hong Kong Polytechnic University; InfiX.ai; Sun Yat-sen University), 4 Aug 2026. arXiv:2608.03028v1, Section 4, Table 2 (#S4.T2), row Qwen3.5-9B, column Overall; row order: Model | Overall | GF | CF | Δ_GF−CF | Activation | Deactivation | PairQwen3.5-9B | 63.8 | 73.9 | 48.1 | 25.9 | 54.9 | 47.1 | 24.7
Every result from this document10MedPIC, Guideline-following accuracy (GF) zero-shot 73.9
Printed as 73.9Independent run, measured Aug 2026Configuration: zero-shot; independent questions; exact option-set matchEvaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoning paper, Zhitian Hou, Yuhang Liu, Pengkai Wang, Zeyu Liu, Guanghao Zhu, Zheng Liu, Shuo Cai, Congkai Xie, Zhijie Sang, Kun Zeng, Hongxia Yang (The Hong Kong Polytechnic University; InfiX.ai; Sun Yat-sen University), 4 Aug 2026. arXiv:2608.03028v1, Section 4, Table 2 (#S4.T2), row Qwen3.5-9B, column GF; row order: Model | Overall | GF | CF | Δ_GF−CF | Activation | Deactivation | PairQwen3.5-9B | 63.8 | 73.9 | 48.1 | 25.9 | 54.9 | 47.1 | 24.7
Every result from this document11MedPIC, Counterfactual accuracy (CF) zero-shot 48.1
Printed as 48.1Independent run, measured Aug 2026Configuration: zero-shot; independent questions; exact option-set matchEvaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoning paper, Zhitian Hou, Yuhang Liu, Pengkai Wang, Zeyu Liu, Guanghao Zhu, Zheng Liu, Shuo Cai, Congkai Xie, Zhijie Sang, Kun Zeng, Hongxia Yang (The Hong Kong Polytechnic University; InfiX.ai; Sun Yat-sen University), 4 Aug 2026. arXiv:2608.03028v1, Section 4, Table 2 (#S4.T2), row Qwen3.5-9B, column CF; row order: Model | Overall | GF | CF | Δ_GF−CF | Activation | Deactivation | PairQwen3.5-9B | 63.8 | 73.9 | 48.1 | 25.9 | 54.9 | 47.1 | 24.7
Every result from this document10MedPIC, Linked counterfactual pair accuracy zero-shot 24.7
Printed as 24.7Independent run, measured Aug 2026Configuration: zero-shot; independent questions; exact option-set matchEvaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoning paper, Zhitian Hou, Yuhang Liu, Pengkai Wang, Zeyu Liu, Guanghao Zhu, Zheng Liu, Shuo Cai, Congkai Xie, Zhijie Sang, Kun Zeng, Hongxia Yang (The Hong Kong Polytechnic University; InfiX.ai; Sun Yat-sen University), 4 Aug 2026. arXiv:2608.03028v1, Section 4, Table 2 (#S4.T2), row Qwen3.5-9B, column Pair; row order: Model | Overall | GF | CF | Δ_GF−CF | Activation | Deactivation | PairQwen3.5-9B | 63.8 | 73.9 | 48.1 | 25.9 | 54.9 | 47.1 | 24.7
Every result from this document17MedPIC, Risk activation accuracy zero-shot 54.9
Printed as 54.9Independent run, measured Aug 2026Configuration: zero-shot; independent questions; exact option-set matchEvaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoning paper, Zhitian Hou, Yuhang Liu, Pengkai Wang, Zeyu Liu, Guanghao Zhu, Zheng Liu, Shuo Cai, Congkai Xie, Zhijie Sang, Kun Zeng, Hongxia Yang (The Hong Kong Polytechnic University; InfiX.ai; Sun Yat-sen University), 4 Aug 2026. arXiv:2608.03028v1, Section 4, Table 2 (#S4.T2), row Qwen3.5-9B, column Activation; row order: Model | Overall | GF | CF | Δ_GF−CF | Activation | Deactivation | PairQwen3.5-9B | 63.8 | 73.9 | 48.1 | 25.9 | 54.9 | 47.1 | 24.7
Every result from this document9MedPIC, Risk deactivation accuracy zero-shot 47.1
Printed as 47.1Independent run, measured Aug 2026Configuration: zero-shot; independent questions; exact option-set matchEvaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoning paper, Zhitian Hou, Yuhang Liu, Pengkai Wang, Zeyu Liu, Guanghao Zhu, Zheng Liu, Shuo Cai, Congkai Xie, Zhijie Sang, Kun Zeng, Hongxia Yang (The Hong Kong Polytechnic University; InfiX.ai; Sun Yat-sen University), 4 Aug 2026. arXiv:2608.03028v1, Section 4, Table 2 (#S4.T2), row Qwen3.5-9B, column Deactivation; row order: Model | Overall | GF | CF | Δ_GF−CF | Activation | Deactivation | PairQwen3.5-9B | 63.8 | 73.9 | 48.1 | 25.9 | 54.9 | 47.1 | 24.7
Every result from this document–MedPIC, Published GF-minus-CF accuracy gap zero-shot 25.9
Printed as 25.9Independent run, measured Aug 2026Configuration: zero-shot; independent questions; exact option-set matchEvaluating Counterfactual Sensitivity to Patient Information in Medication-Safety Reasoning paper, Zhitian Hou, Yuhang Liu, Pengkai Wang, Zeyu Liu, Guanghao Zhu, Zheng Liu, Shuo Cai, Congkai Xie, Zhijie Sang, Kun Zeng, Hongxia Yang (The Hong Kong Polytechnic University; InfiX.ai; Sun Yat-sen University), 4 Aug 2026. arXiv:2608.03028v1, Section 4, Table 2 (#S4.T2), row Qwen3.5-9B, column Δ_GF−CF; row order: Model | Overall | GF | CF | Δ_GF−CF | Activation | Deactivation | PairQwen3.5-9B | 63.8 | 73.9 | 48.1 | 25.9 | 54.9 | 47.1 | 24.7
Every result from this document
Other Alibaba models: Lingshu-32B, Lingshu-7B, Qwen3-14B, Qwen3-235B-A22B-Instruct-2507, Qwen3-32B, Qwen3-4B, Qwen 3.5, Qwen3.5-27B, Qwen3.5-35B-A3B, Qwen3.5 397B A17B, Qwen 3.5 Flash, Qwen3.5-Plus, Qwen3.6-Max, Qwen3.6 Plus, Qwen 3.7 Max, Qwen3.7 Plus, Qwen 3.8 27B, Qwen3.8 Max, Qwen 3 Max Thinking, Qwen3-VL-235B-A22B, Qwen 3 VL Plus