APEX-Agents-AA
Artificial Analysis · Knowledge work
- Winner
- Gemini 3.5 Flash47.05%
- Next listed
- Qwen3.8 Max (0902)Alibaba42.40%
55 independent leaderboards, read 17 October 2026. Each stays tied to its publisher and date instead of being averaged into one score.
The latest top two from each independent leaderboard. A dash means no runner-up is published yet.
| Benchmark | Leader | Score | Next listed model | Score | Models run | Updated |
|---|---|---|---|---|---|---|
| APEX-Agents-AAArtificial Analysis · Knowledge work | Gemini 3.5 Flash | 47.05% | Qwen3.8 Max (0902)Alibaba | 42.40% | 32spread 15.04% | 30 Sept 2026 |
| τ³-BankingArtificial Analysis · Tool use | Qwen3.8 MaxAlibaba | 51.34% | Muse Spark 1.3Meta | 50.52% | 154spread 5.98% | 30 Sept 2026 |
| ITBench-AAArtificial Analysis · IT operations | GPT-5.6 SolOpenAI | 56.21% | Gemini 3.8 FlashGoogle | 52.54% | 42spread 9.55% | 30 Sept 2026 |
| IFBenchArtificial Analysis · Instruction following | Grok 4.20 0309 | 82.93% | MiniMax-M3MiniMax | 82.86% | 331spread 4.15% | 30 Sept 2026 |
| AIME 2025Artificial Analysis · Mathematics | GPT-5.2 | 99.00% | GPT-5 Codex | 98.67% | 208spread 4.67% | 30 Sept 2026 |
| AA-AnalystAgentArtificial Analysis · Data analysis | Gemini 3.7 FlashGoogle | 60.00% | Claude Fable 5.1Anthropic | 57.50% | 33spread 15.00% | 30 Sept 2026 |
| MLCR-AAArtificial Analysis · Medical reasoning | Claude Sonnet 5.5Anthropic | 75.00% | Claude Fable 5.1Anthropic | 71.11% | 70spread 31.67% | 30 Sept 2026 |
| ARC-AGI-3ARC Prize · Standard · Interactive reasoning | GPT-6 Astra (Max)OpenAI | 62.71% | Claude Opus 5 (High)Anthropic | 30.16% | 17spread 62.28% | 30 Sept 2026 |
| SWE-Bench Pro V2 FullScale AI / SEAL · Repository coding | Opus 5 (Claude Code) xhighAnthropic | 99.40% | Fable 5.1 (Claude Code) highAnthropic | 99.10% | 10spread 9.52% | 22 Sept 2026 |
| SWE-Bench Pro V2 HARDScale AI / SEAL · Repository coding | Opus 5 (Claude Code) xhighAnthropic | 98.00% | Fable 5.1 (Claude Code) highAnthropic | 92.20% | 11spread 41.10% | 22 Sept 2026 |
| Vals RSI IndexVals AI · Autonomous research | Claude Opus 5.5Anthropic | 37.31% | Claude Fable 5.1Anthropic | 36.09% | 23spread 13.43% | 29 Sept 2026 |
| Vibe Code Bench 1–100Vals AI · Application development | Claude Opus 5.5Anthropic | 30.36% | Claude Opus 5Anthropic | 28.53% | 20spread 12.12% | 29 Sept 2026 |
| CUA-benchVals AI · Computer use | GPT-6 AstraOpenAI | 19.17% | Claude Opus 5.5Anthropic | 14.00% | 8spread 15.00% | 29 Sept 2026 |
| τ²-Bench TelecomArtificial Analysis · Tool use | JT-35B-Flash | 99.12% | GLM-5.2Tied first | 99.12% | 323spread 1.46% | 30 Sept 2026 |
| Harvey LAB-AAArtificial Analysis · Legal reasoning | Muse Spark 1.3Meta | 95.48% | Kimi K3Moonshot AI | 94.64% | 42spread 4.40% | 8 Oct 2026 |
| EnterpriseOps-Gym-AAArtificial Analysis · Enterprise workflows | Claude Fable 5Anthropic | 51.12% | Gemini 3.7 FlashGoogle | 50.40% | 47spread 4.03% | 30 Sept 2026 |
| AutomationBench-AAArtificial Analysis · Workflow automation | Gemini 4 ArgonGoogle | 77.51% | Claude Sonnet 5.5Anthropic | 71.33% | 140spread 15.31% | 8 Oct 2026 |
| SciCodeArtificial Analysis · Scientific coding | Claude Opus 5.5Anthropic | 66.90% | Claude Fable 5.1Anthropic | 63.08% | 144spread 8.10% | 8 Oct 2026 |
| GDP.pdfArtificial Analysis · Document reasoning | GPT-6.1 SolOpenAI | 31.00% | GPT-6 AstraOpenAITied first | 31.00% | 130spread 7.00% | 8 Oct 2026 |
| CritPtArtificial Analysis · Scientific reasoning | GPT-5.6 SolOpenAI | 32.29% | GPT-6.1 SolOpenAI | 31.71% | 386spread 2.58% | 8 Oct 2026 |
| AA-OmniscienceArtificial Analysis · Factual knowledge | Claude Opus 5.5Anthropic | 46.42 | Claude Fable 5.1Anthropic | 43.45 | 383spread 14.54 | 8 Oct 2026 |
| AA-LCR v1.1Artificial Analysis · Long-context reasoning | Kimi K3Moonshot AI | 88.67% | Step 5 PreviewStepFun | 88.33% | 386spread 5.00% | 8 Oct 2026 |
| Terminal-Bench 4.0Artificial Analysis · Agentic coding | Claude Sonnet 5.5Anthropic | 63.64% | Claude Opus 5.5Anthropic | 59.60% | 137spread 21.72% | 8 Oct 2026 |
| Terminal-Bench 2.1Vals AI · Agentic coding | Claude Opus 5.5Anthropic | 87.64% | GPT-6 AstraOpenAI | 87.27% | 75spread 7.12% | 27 Sept 2026 |
| SWE-bench (Verified)Vals AI · Software engineering | Claude Opus 5Anthropic | 97.00% | DeepSeek V4 ProDeepSeek | 96.40% | 88spread 5.00% | 1 Sept 2026 |
| LiveCodeBenchVals AI · Code generation | Claude Fable 5.1Anthropic | 90.52% | Claude Fable 5Anthropic | 89.78% | 143spread 2.67% | 1 Sept 2026 |
| GPQA DiamondVals AI · Science reasoning | Gemini 3.1 ProGoogle | 95.45% | GPT-5.6 SolOpenAI | 95.20% | 138spread 2.27% | 1 Sept 2026 |
| MMLU ProVals AI · Knowledge | Claude Fable 5.1Anthropic | 92.38% | Claude Opus 5Anthropic | 91.59% | 138spread 2.86% | 1 Sept 2026 |
| MMMU ProVals AI · Multimodal reasoning | Claude Fable 5.1Anthropic | 90.64% | Claude Opus 5Anthropic | 89.88% | 93spread 2.43% | 1 Sept 2026 |
| Vibe Code Bench v1.1Vals AI · Product coding | Claude Sonnet 5.5Anthropic | 92.39% | Gemini 4 ArgonGoogle | 91.91% | 106spread 6.22% | 29 Sept 2026 |
| Terminal-Bench Science 0.1Artificial Analysis · Agentic science | GPT-6 AstraOpenAI | 63.33% | Claude Opus 5.5Anthropic | 59.05% | 27spread 49.52% | 8 Oct 2026 |
| ProgramBenchVals AI · Agentic coding | Claude Opus 5.5Anthropic | 18.50% | Claude Fable 5.1Anthropic | 7.00% | 54spread 17.00% | 29 Sept 2026 |
| ProofBench v1.1Vals AI · Mathematics | Claude Sonnet 5.5Anthropic | 100.00% | Claude Opus 5.5AnthropicTied first | 100.00% | 46spread 13.00% | 29 Sept 2026 |
| LegalBenchVals AI · Professional knowledge | Claude Fable 5Anthropic | 88.56% | Claude Fable 5.1Anthropic | 88.51% | 149spread 1.70% | 29 Sept 2026 |
| Harvey's Legal Agent BenchmarkVals AI · Professional knowledge | Muse Spark 1.2Meta | 25.42% | Muse Spark 1.3 MaxMeta | 23.75% | 73spread 14.17% | 30 Sept 2026 |
| SkillsBenchVals AI · Agentic tooling | DeepSeek V4.1 FlashDeepSeek | 69.80% | Grok 4.5xAI | 66.03% | 35spread 10.61% | 27 Sept 2026 |
| MysteryMechanismVals AI · Scientific reasoning | GPT-6 AstraOpenAI | 53.15% | Claude Opus 5.5Anthropic | 49.55% | 21spread 19.82% | 29 Sept 2026 |
| Vals Multimodal IndexVals AI · Composite | Claude Fable 5Anthropic | 74.15% | Claude Opus 5Anthropic | 73.90% | 33spread 6.79% | 11 Aug 2026 |
| BioMysteryBenchVals AI · Agentic science | Claude Sonnet 5.5Anthropic | 81.11% | GPT-6.1 SolOpenAI | 79.63% | 21spread 10.00% | 29 Sept 2026 |
| Code MigrationVals AI · Agentic coding | Claude Sonnet 5.5Anthropic | 69.83% | Gemini 4 ArgonGoogle | 68.17% | 71spread 16.91% | 29 Sept 2026 |
| CyberBench v1.1Vals AI · Security | GPT-6 SolOpenAI | 77.98% | Gemini 4 ArgonGoogle | 77.86% | 43spread 5.00% | 29 Sept 2026 |
| EMBVals AI · Financial modelling | Claude Fable 5.1Anthropic | 76.67% | Claude Opus 5.5Anthropic | 75.94% | 69spread 5.14% | 29 Sept 2026 |
| Finance Agent (v2)Vals AI · Financial analysis | Gemini 4 ArgonGoogle | 65.40% | Gemini 3.8 FlashGoogle | 61.44% | 73spread 7.30% | 29 Sept 2026 |
| IOIVals AI · Competitive programming | Gemini 4 ArgonGoogle | 100.00% | GPT-6 AstraOpenAITied first | 100.00% | 38spread 17.39% | 29 Sept 2026 |
| Legal Research BenchVals AI · Professional knowledge | Muse Spark 1.3 MaxMeta | 55.29% | Claude Opus 5AnthropicTied first | 55.29% | 72spread 7.21% | 29 Sept 2026 |
| MedCodeVals AI · Healthcare administration | Claude Opus 5Anthropic | 63.57% | Gemini 3.1 ProGoogle | 59.06% | 104spread 10.35% | 29 Sept 2026 |
| MedScribeVals AI · Healthcare administration | Claude Opus 5.5Anthropic | 91.43% | Claude Fable 5.1Anthropic | 91.29% | 106spread 2.91% | 29 Sept 2026 |
| Public Benefits Bench v1.1Vals AI · Public services | Claude Opus 5Anthropic | 76.93% | Claude Fable 5.1Anthropic | 74.90% | 45spread 8.66% | 29 Sept 2026 |
| SAGEVals AI · Education | Claude Opus 4.7Anthropic | 56.10% | Gemma 4 31b It | 55.03% | 90spread 4.25% | 29 Sept 2026 |
| SRE BenchVals AI · Security | GPT-6 AstraOpenAI | 56.87% | GPT-6.1 SolOpenAI | 50.76% | 16spread 52.67% | 29 Sept 2026 |
| Tax Agent BenchVals AI · Professional knowledge | Claude Fable 5.1Anthropic | 77.64% | Gemini 4 ArgonGoogle | 76.23% | 64spread 7.82% | 29 Sept 2026 |
| DeepSWE v1.1Datacurve · Software engineering | GPT-6 AstraOpenAI | 74.12% | Gemini 3.8 FlashGoogle | 73.83% | 28spread 6.93% | 22 Sept 2026 |
| GDPval-AA v2.1Artificial Analysis · Knowledge work | Claude Opus 5.5Anthropic | 1,846.17 | Claude Sonnet 5.5Anthropic | 1,844.21 | 188spread 205.39 | 8 Oct 2026 |
| AA-Briefcase v1.1Artificial Analysis · Knowledge work | Claude Opus 5.5Anthropic | 1,821.85 | Claude Sonnet 5.5Anthropic | 1,810.9 | 142spread 252.99 | 8 Oct 2026 |
| Humanity's Last ExamArtificial Analysis · Multidisciplinary reasoning | Claude Opus 5.5Anthropic | 61.35% | Claude Fable 5.1Anthropic | 59.13% | 466spread 12.00% | 8 Oct 2026 |
Artificial Analysis · Knowledge work
Artificial Analysis · Tool use
Artificial Analysis · IT operations
Artificial Analysis · Instruction following
Artificial Analysis · Mathematics
Artificial Analysis · Data analysis
Artificial Analysis · Medical reasoning
ARC Prize · Standard · Interactive reasoning
Scale AI / SEAL · Repository coding
Scale AI / SEAL · Repository coding
Vals AI · Autonomous research
Vals AI · Application development
Vals AI · Computer use
Artificial Analysis · Tool use
Artificial Analysis · Legal reasoning
Artificial Analysis · Enterprise workflows
Artificial Analysis · Workflow automation
Artificial Analysis · Scientific coding
Artificial Analysis · Document reasoning
Artificial Analysis · Scientific reasoning
Artificial Analysis · Factual knowledge
Artificial Analysis · Long-context reasoning
Artificial Analysis · Agentic coding
Vals AI · Agentic coding
Vals AI · Software engineering
Vals AI · Code generation
Vals AI · Science reasoning
Vals AI · Knowledge
Vals AI · Multimodal reasoning
Vals AI · Product coding
Artificial Analysis · Agentic science
Vals AI · Agentic coding
Vals AI · Mathematics
Vals AI · Professional knowledge
Vals AI · Professional knowledge
Vals AI · Agentic tooling
Vals AI · Scientific reasoning
Vals AI · Composite
Vals AI · Agentic science
Vals AI · Agentic coding
Vals AI · Security
Vals AI · Financial modelling
Vals AI · Financial analysis
Vals AI · Competitive programming
Vals AI · Professional knowledge
Vals AI · Healthcare administration
Vals AI · Healthcare administration
Vals AI · Public services
Vals AI · Education
Vals AI · Security
Vals AI · Professional knowledge
Datacurve · Software engineering
Artificial Analysis · Knowledge work
Artificial Analysis · Knowledge work
Artificial Analysis · Multidisciplinary reasoning
Independent runs only. Each first place counts once; ties count for both labs.
| Lab | First places | Top-three finishes | Leading benchmarks |
|---|---|---|---|
| Anthropic | 31 | 40 | 28 more benchmarks
|
| OpenAI | 11 | 20 | |
| 6 | 21 | ||
| Meta | 3 | 5 | |
| Moonshot AI | 1 | 5 | |
| Alibaba | 1 | 3 | |
| DeepSeek | 1 | 2 | |
| xAI | 0 | 2 | No benchmark wins |
| Z.ai | 0 | 2 | No benchmark wins |
| MiniMax | 0 | 1 | No benchmark wins |
| StepFun | 0 | 1 | No benchmark wins |
| Xiaomi | 0 | 1 | No benchmark wins |
Leading benchmarks
Leading benchmarks
Leading benchmarks
Leading benchmarks
Leading benchmarks
Leading benchmarks
Leading benchmarks
Leading benchmarks
No benchmark winsLeading benchmarks
No benchmark winsLeading benchmarks
No benchmark winsLeading benchmarks
No benchmark winsLeading benchmarks
No benchmark winsRead the indices last, not first: each is one publisher’s weighting over its own suite, and the two share no task and no harness.
Vals AI · 41 models · updated 30 September 2026
| # | Model | Score |
|---|---|---|
| 1 | Gemini 4 Argon | 68.90% |
| 2 | Claude Sonnet 5.5 | 67.04% |
| 3 | Claude Opus 5.5 | 66.97% |
| 4 | Claude Fable 5.1 | 65.83% |
| 5 | Claude Opus 5 | 63.67% |
| 6 | GPT-6 Astra | 63.13% |
| 7 | Claude Fable 5 | 61.39% |
| 8 | GPT-6.1 Sol | 61.15% |
Top eight shown. Search to find another model. A GDP-weighted composite of Vals AI’s agentic finance, coding, legal and tax evaluations, intended to represent potential economic impact.
Ranks here are the publisher's own list.
Artificial Analysis · 492 models · updated 8 October 2026
| # | Model | Index |
|---|---|---|
| 1 | Claude Opus 5.5 | 58 |
| 2 | Claude Sonnet 5.5 | 56 |
| 3 | Claude Fable 5.1 | 53 |
| 3 | Gemini 4 Argon | 53 |
| 3 | GPT-6 Astra | 53 |
| 6 | GPT-6.1 Sol | 52 |
| 7 | Claude Opus 5 | 51 |
| 8 | Claude Fable 5 | 50 |
Top eight shown. Search to find another model. An index over a fixed suite of reasoning, coding, mathematics and agentic evaluations, reported on its own scale rather than as a percentage.
Artificial Analysis ranks 492 models; this site lists the 42 it read, so these ranks are among those 42 only.