SAGE
Whether a model can grade student mathematics work against rubrics — the assessment load teachers carry — rather than only solving the problem itself.
How it is run
The dataset spans automata, linear algebra, calculus and partial differential equations, drawn from course materials and past examination questions, with rubric-based grading. Vals also measures which answers each model grades too harshly or too leniently.
What it cannot tell you
Substantial grading errors remain even in the strongest runs. Vals’ analysis finds correct answers easier to grade than incorrect ones, with grading bias varying by model; the overall score can hide that difference.
- Leader
- Claude Opus 4.756.10% · Vals AI's own list
- Top-ten spread
- 4.25%Leader minus tenth place, or last place in smaller fields.
- Median
- 44.16%of the 90 rows published
- No published result
- 14of 46 models on this site
Independent leaderboard · Vals AI
Top 90 of 90 runs by Vals AI, one harness.
| # | Model | Score |
|---|---|---|
| 1 | Claude Opus 4.7 | 56.10% |
| 2 | Gemma 4 31b It | 55.03% |
| 3 | Claude Opus 4.8 | 54.79% |
| 4 | Kimi K3 | 54.26% |
| 5 | Gemini 4 Argon | 53.65% |
| 6 | GPT-5.6 Sol | 52.56% |
| 7 | Qwen3.8 27b | 52.40% |
| 8 | Claude Opus 4 5 20251101 Thinking | 52.09% |
| 9 | Claude Fable 5 | 51.89% |
| 10 | Gemini 3 Flash Preview | 51.85% |
| 11 | Claude Sonnet 5.5 | 51.77% |
| 12 | Claude Opus 4 6 Thinking | 51.58% |
| 13 | GPT-5.5 | 51.53% |
| 14 | Qwen3.8 Max | 51.25% |
| 15 | Gpt 5.4 Mini 2026 03 17 | 50.81% |
| 16 | MiniMax M3 | 50.57% |
| 17 | Kimi K2.6 | 50.22% |
| 18 | Gemini 3.5 Flash | 49.88% |
| 19 | Kimi K2.5 Thinking | 49.87% |
| 20 | Gemini 3.1 Flash Lite Preview | 49.54% |
| 21 | Claude Opus 5 | 49.43% |
| 22 | Gpt 5.2 2025 12 11 | 49.27% |
| 23 | Gemini 3.7 Flash | 49.23% |
| 24 | Claude Sonnet 5 | 48.92% |
| 25 | Gemini 3.6 Flash | 48.69% |
| 26 | Gemini 3.1 Pro | 48.68% |
| 27 | Claude Fable 5.1 | 48.53% |
| 28 | GPT-6 Luna | 48.09% |
| 29 | DeepSeek V4.1 Flash | 47.88% |
| 30 | Muse Spark 1.2 | 47.66% |
| 31 | Gemini 3 Pro Preview | 47.62% |
| 32 | Gemini 3.5 Flash Lite | 47.30% |
| 33 | GPT-5.6 Terra | 47.00% |
| 34 | Claude Sonnet 4 6 | 46.58% |
| 35 | GPT-6.1 Sol | 46.54% |
| 36 | GPT-6 Astra | 46.37% |
| 37 | Claude Opus 5.5 | 45.83% |
| 38 | Muse Spark 1 1 | 45.58% |
| 38 | Qwen3.6 27b | 45.58% |
| 40 | MiMo V2.6 Pro | 45.05% |
| 41 | Claude Opus 4 5 20251101 | 45.00% |
| 42 | Qwen3.6 Plus | 44.86% |
| 43 | GPT-6 Sol | 44.79% |
| 44 | Gemini 2.5 Flash | 44.76% |
| 45 | GPT-5.6 Luna | 44.22% |
| 46 | Gemini 2.5 Flash Preview 09 2025 | 44.11% |
| 47 | Gpt 5 2025 08 07 | 43.68% |
| 48 | MiMo-V2.6-Flash | 43.53% |
| 49 | Gpt 5.4 2026 03 05 | 43.31% |
| 50 | Mimo V2.5 | 43.27% |
| 51 | Gpt 5.1 2025 11 13 | 43.23% |
| 52 | Gpt 5 Mini 2025 08 07 | 42.99% |
| 53 | Qwen3.5 Flash | 42.49% |
| 54 | Qwen3 Vl Plus 2025 09 23 | 42.10% |
| 55 | Gemini 2.5 Pro | 41.92% |
| 56 | O3 2025 04 16 | 41.77% |
| 57 | O4 Mini 2025 04 16 | 41.06% |
| 58 | Grok 4.7 | 40.79% |
| 59 | Gemini 2.5 Flash Thinking | 39.60% |
| 60 | Gemini 2.5 Flash Preview 09 2025 Thinking | 39.38% |
| 61 | Qwen3.7 Plus | 39.25% |
| 62 | Grok 4.20 0309 Reasoning | 38.24% |
| 63 | Gpt 5.4 Nano 2026 03 17 | 38.08% |
| 64 | Mistral Medium 3.5 | 37.61% |
| 65 | Inkling | 36.55% |
| 66 | Claude Sonnet 4 5 20250929 Thinking | 36.06% |
| 67 | Llama4 Maverick Instruct Basic | 35.70% |
| 68 | Gemini 3.8 Flash | 35.06% |
| 69 | Claude Sonnet 4 20250514 | 35.00% |
| 70 | Grok 4.5 | 34.97% |
| 71 | Llama 4 Scout 17B 16E Instruct | 34.83% |
| 72 | Claude Sonnet 4 5 20250929 | 32.88% |
| 73 | Inkling Small | 32.74% |
| 74 | Claude Sonnet 4 20250514 Thinking | 32.01% |
| 75 | Claude Haiku 4 5 20251001 Thinking | 31.82% |
| 76 | Claude Opus 4 1 20250805 | 31.38% |
| 77 | Grok 4 1 Fast Reasoning | 31.33% |
| 78 | Gemini 2.5 Flash Lite Preview 09 2025 Thinking | 30.78% |
| 79 | Qwen3.5 Plus Thinking | 30.40% |
| 80 | Claude Opus 4 1 20250805 Thinking | 30.39% |
| 81 | Gpt 5 Nano 2025 08 07 | 30.38% |
| 82 | Grok 4 Fast Reasoning | 29.76% |
| 83 | Grok 4.6 | 28.90% |
| 84 | Gemini 2.5 Flash Lite Preview 09 2025 | 27.97% |
| 85 | Gemini 2.5 Flash Lite | 27.53% |
| 86 | Grok 4 0709 | 25.10% |
| 87 | Mistral Large 2512 | 24.59% |
| 88 | Grok 4.3 | 19.74% |
| 89 | Grok 4 Fast Non Reasoning | 15.99% |
| 90 | Grok 4 1 Fast Non Reasoning | 11.91% |
No published result tracked
14 of the 46 models on this site have no published number on this benchmark, so their cells in the home table stay blank rather than reading as zero.
Sources
Every page used for this benchmark, read on 17 October 2026.
- Benchmark site or the page that publishes itwww.vals.ai/benchmarks/sage
- Independent resultswww.vals.ai/benchmarks/sage