AIEvals

Benchmarks

AIME 2025

Olympiad mathematics from the 2025 American Invitational Mathematics Examination.

MathematicsMathematical Association of America208 models run by Artificial AnalysisUpdated 30 September 2026

How it is run

Accuracy on 30 problems with integer answers, using AA’s published model configurations.

What it cannot tell you

Legacy, small and near-saturated for leading models; published problems can enter training data.

Leader
GPT-5.299.00% · Artificial Analysis results, grouped here by release
Top-ten spread
4.67%Leader minus tenth place, or last place in smaller fields.
Median
52.33%of the 208 rows published
No published result
46of 46 models on this site

Artificial Analysis results by release

Highest published effort per model release, grouped here from AA’s public results. Grouping ranks are derived here; source settings and model-publisher reports stay separate.

#ModelScoreEffort
1GPT-5.299.00%xhigh
2GPT-5 Codex98.67%high
3DeepSeek V3.2 Speciale96.67%Not specified
4GPT-5.1 Codex95.67%high
4Gemini 3 Pro Preview95.67%high
6GLM-4.795.00%Not specified
7Kimi K2 Thinking94.67%Not specified
7KAT-Coder-Pro V194.67%Not specified
9GPT-594.33%high
9Nova 2.0 Lite94.33%high
11GPT-5.194.00%high
12gpt-oss-120b93.44%high
13Grok 492.67%Not specified
14GPT-5.1 Codex mini91.67%high
15Claude Opus 4.591.33%Not specified
16Qwen3 235B A22B 2507 (Reasoning)91.00%Not specified
17GPT-5 mini90.67%high
17o4-mini90.67%high
19K-EXAONE90.33%Not specified
20Nova 2.0 Omni89.67%medium
20DeepSeek V3.1 Terminus89.67%Not specified
20DeepSeek V3.189.67%Not specified
23gpt-oss-20b89.33%high
23Grok 4.1 Fast89.33%Not specified
23Ring-1T89.33%Not specified
26Nova 2.0 Pro Preview89.00%medium
27o388.33%Not specified
27Qwen3 VL 235B A22B (Reasoning)88.33%Not specified
29INTELLECT-388.00%Not specified
29Claude 4.5 Sonnet88.00%Not specified
29Apriel-v1.6-15B-Thinker88.00%Not specified
32Gemini 2.5 Pro87.67%Not specified
33Apriel-v1.5-15B-Thinker87.50%Not specified
34GLM-4.686.00%Not specified
35ERNIE 5.0 Thinking Preview85.00%Not specified
36Seed-OSS-36B-Instruct84.67%Not specified
36Qwen3 VL 32B (Reasoning)84.67%Not specified
36Grok 3 mini Reasoning84.67%high
39Qwen3 Next 80B A3B (Reasoning)84.33%Not specified
40GPT-5 nano83.67%high
40Ring-flash-2.083.67%Not specified
40Claude 4.5 Haiku83.67%Not specified
43MiniMax-M2.182.67%Not specified
43Qwen3 4B 2507 (Reasoning)82.67%Not specified
45Qwen3 Max Thinking (Preview)82.33%Not specified
45Qwen3 VL 30B A3B (Reasoning)82.33%Not specified
47Magistral Medium 1.282.00%Not specified
48GLM-4.5-Air80.67%Not specified
48Qwen3 Max80.67%Not specified
50Motif-2-12.7B-Reasoning80.33%Not specified
50Magistral Small 1.280.33%Not specified
50Claude 4.1 Opus80.33%Not specified
53Falcon-H1R-7B80.00%Not specified
54o1-preview79.67%Not specified
55Doubao Seed Code79.33%Not specified
56Mi:dm K 2.5 Pro Preview78.67%Not specified
57K2-V278.33%high
57MiniMax-M278.33%Not specified
59Olmo 3.1 32B Think77.33%Not specified
60Mi:dm K 2.5 Pro76.67%Not specified
61DeepSeek R1 0528 (May '25)76.00%Not specified
62Qwen3 Max (Preview)75.00%Not specified
62NVIDIA Nemotron Nano 12B v2 VL75.00%Not specified
64Claude 4 Sonnet74.33%Not specified
65Qwen3 Omni 30B A3B (Reasoning)74.00%Not specified
66GLM-4.573.67%Not specified
66Olmo 3 32B Think73.67%Not specified
68Gemini 2.5 Flash73.33%Not specified
69Qwen3 32B73.00%Not specified
70Cogito v2.172.67%Not specified
71Qwen3 30B A3B72.33%Not specified
71Qwen3 VL 30B A3B Instruct72.33%Not specified
73Qwen3 235B A22B 250771.67%Not specified
74Ling-1T71.33%Not specified
75Olmo 3 7B Think70.67%Not specified
75Qwen3 VL 235B A22B Instruct70.67%Not specified
77Hermes 4 - Llama-3.1 405B69.67%Not specified
78Qwen3 VL 32B Instruct68.33%Not specified
79DeepSeek R1 (Jan '25)68.00%Not specified
80MiMo-V2-Flash67.67%Not specified
81Qwen3 Next 80B A3B Instruct66.33%Not specified
81Qwen3 30B A3B 250766.33%Not specified
83Ling-flash-2.065.33%Not specified
84DeepSeek R1 0528 Qwen3 8B63.67%Not specified
84Llama 3.1 Nemotron Ultra 253B v163.67%Not specified
86DeepSeek R1 Distill Qwen 32B63.00%Not specified
87NVIDIA Nemotron Nano 9B V262.33%Not specified
88Solar Pro 261.33%high
89MiniMax M1 80k61.00%Not specified
90HyperCLOVA X SEED Think (32B)59.00%Not specified
90DeepSeek V3.259.00%Not specified
92Grok 358.00%Not specified
93DeepSeek V3.2 Exp57.67%Not specified
94Kimi K2 090557.33%Not specified
95Kimi K257.00%Not specified
96Gemini 2.5 Flash Preview (Sep '25)56.67%Not specified
97Claude 3.7 Sonnet56.33%Not specified
97Qwen3 30B A3B 2507 (Reasoning)56.33%Not specified
99Qwen3 14B55.67%Not specified
99Gemini 3 Flash Preview55.67%Not specified
99DeepSeek R1 Distill Qwen 14B55.67%Not specified
102Llama 3.3 Nemotron Super 49B v154.67%Not specified
103DeepSeek R1 Distill Llama 70B53.67%Not specified
104Qwen3 Omni 30B A3B Instruct52.33%Not specified
104Qwen3 4B 250752.33%Not specified
106Llama 3.1 Nemotron Nano 4B v1.150.00%Not specified
107Ling-mini-2.049.33%Not specified
108GPT-5 (ChatGPT)48.33%Not specified
109Gemini 2.5 Flash-Lite Preview (Sep '25)46.67%Not specified
110GPT-4.1 mini46.33%Not specified
111Grok Code Fast 143.33%Not specified
112DeepSeek R1 Distill Llama 8B41.33%Not specified
112Magistral Small 141.33%Not specified
112Grok 4 Fast41.33%Not specified
112Olmo 3 7B Instruct41.33%Not specified
112ERNIE 4.5 300B A47B41.33%Not specified
117DeepSeek V3 032441.00%Not specified
118Magistral Medium 140.33%Not specified
119Qwen3 Coder 480B A35B Instruct39.33%Not specified
119EXAONE 4.0 32B39.33%Not specified
121Mistral Medium 3.138.33%Not specified
122Mistral Large 338.00%Not specified
123Qwen3 VL 4B Instruct37.00%Not specified
124Devstral 236.67%Not specified
125Claude 4 Opus36.33%Not specified
125Kimi Linear 48B A3B Instruct36.33%Not specified
127Gemini 2.5 Flash-Lite35.33%Not specified
128GPT-4.134.67%Not specified
129Devstral Small 234.33%Not specified
130Reka Flash 333.67%Not specified
131Ministral 3 8B31.67%Not specified
132Qwen3 VL 8B (Reasoning)30.67%Not specified
133Mistral Medium 330.33%Not specified
134Ministral 3 14B30.00%Not specified
135Devstral Small (Jul '25)29.33%Not specified
136QwQ 32B29.00%Not specified
136Qwen3 Coder 30B A3B Instruct29.00%Not specified
138Qwen3 VL 8B Instruct27.33%Not specified
139Mistral Small 3.227.00%Not specified
140GLM-4.6V26.33%Not specified
141DeepSeek V3 (Dec '24)26.00%Not specified
142GPT-4o (March 2025, chatgpt-4o-latest)25.67%Not specified
142Qwen3 VL 4B (Reasoning)25.67%Not specified
144LFM2 8B A1B25.33%Not specified
145GPT-4.1 nano24.00%Not specified
145Exaone 4.0 1.2B24.00%Not specified
147Qwen3 235B A22B23.67%Not specified
148Qwen3 4B22.33%Not specified
149DeepSeek R1 Distill Qwen 1.5B22.00%Not specified
149Ministral 3 3B22.00%Not specified
151Gemini 2.0 Flash (Feb '25)21.67%Not specified
152Gemma 3 27B Instruct20.67%Not specified
153Llama 4 Maverick19.33%Not specified
154Qwen3 8B19.00%Not specified
155Gemma 3 12B Instruct18.33%Not specified
156Phi-418.00%Not specified
157Nova Premier17.33%Not specified
158GLM-4.5V15.33%Not specified
159GPT-4o mini14.67%Not specified
160Gemma 3n E4B Instruct14.33%Not specified
161Mistral Large 2 (Nov '24)14.00%Not specified
161Llama 4 Scout14.00%Not specified
161Qwen2.5 Instruct 72B14.00%Not specified
164MiniMax M1 40k13.67%Not specified
164Granite 4.0 H Small13.67%Not specified
166NVIDIA Nemotron 3 Nano 30B A3B13.33%Not specified
167Command A13.00%Not specified
168Gemma 3 4B Instruct12.67%Not specified
169Hermes 4 - Llama-3.1 70B11.33%Not specified
170Llama 3.1 Nemotron Instruct 70B11.00%Not specified
171Jamba Reasoning 3B10.67%Not specified
172Qwen3 0.6B10.33%Not specified
172Gemma 3n E2B Instruct10.33%Not specified
174LFM2 2.6B8.33%Not specified
175Llama Nemotron Super 49B v1.58.00%Not specified
176Llama 3.3 Instruct 70B7.67%Not specified
177Qwen3 1.7B7.33%Not specified
178Nova Pro7.00%Not specified
178Nova Lite7.00%Not specified
180Granite 3.3 8B6.67%Not specified
180Phi-4 Mini Instruct6.67%Not specified
182Granite 4.0 1B6.33%Not specified
182Granite 4.0 H 1B6.33%Not specified
184Granite 4.0 Micro6.00%Not specified
184Nova Micro6.00%Not specified
184GPT-4o (Nov '24)6.00%Not specified
187Devstral Medium4.67%Not specified
188Llama 3.1 Instruct 8B4.33%Not specified
188Mistral Small 34.33%Not specified
190Llama 3.1 Instruct 70B4.00%Not specified
191Mistral Small 3.13.67%Not specified
192LFM2 1.2B3.33%Not specified
192OLMo 2 32B3.33%Not specified
192Llama 3.2 Instruct 3B3.33%Not specified
192Gemma 3 1B Instruct3.33%Not specified
196Llama 3.1 Instruct 405B3.00%Not specified
197Gemma 3 270M2.33%Not specified
197Jamba 1.7 Large2.33%Not specified
197Pixtral Large2.33%Not specified
200Llama 3.2 Instruct 11B (Vision)1.67%Not specified
201Granite 4.0 H 350M1.33%Not specified
202OLMo 2 7B0.67%Not specified
203Jamba 1.7 Mini0.33%Not specified
203Phi-3 Mini Instruct 3.8B0.33%Not specified
205Mistral Large 2 (Jul '24)0.00%Not specified
205Granite 4.0 350M0.00%Not specified
205Llama 3.2 Instruct 1B0.00%Not specified
205Molmo 7B-D0.00%Not specified

No published result tracked

46 of the 46 models on this site have no published number on this benchmark, so their cells in the home table stay blank rather than reading as zero.

Read this with

Benchmarks in the same category, which usually disagree with this one on purpose.

Sources

Every page used for this benchmark, read on 17 October 2026.