- AA-Omniscience Accuracy11.9%#204
- Humanity's Last Exam6.4%#181
- AA-LCR35%#167
- CritPt0%#143
- MMMU-Pro62%#87
- GPQA Diamond66.1%#130
- IFBench45.2%#70
- τ²-Bench Telecom31.9%#81
- Terminal-Bench Hard11.4%#53
Gemma 4 12B (Non-reasoning)Median
Data from Artificial Analysis