AIEvals

Benchmarks

Vals Index

A GDP-weighted composite of Vals AI’s agentic finance, coding, legal and tax evaluations, intended to represent potential economic impact.

CompositeVals AI41 models run by Vals AIUpdated 30 September 2026Reported by Google DeepMind

How it is run

Version 2.1 combines agentic finance, coding, legal and tax evaluations, weighted by each sector’s share of U.S. GDP. The component tasks and weights define this index.

What it cannot tell you

A composite is an editorial choice. A model that wins the index can lose every individual benchmark a buyer actually cares about, so the index is a starting point rather than a result.

Leader
Gemini 4 Argon68.90% · Vals AI's own list
Top-ten spread
10.89%Leader minus tenth place, or last place in smaller fields.
Median
53.23%of the 33 models on this site
No published result
13of 46 models on this site

Independent leaderboard · Vals AI

Top 41 of 41 runs by Vals AI, one harness.

#ModelScore
1Gemini 4 Argon68.90%
2Claude Sonnet 5.567.04%
3Claude Opus 5.566.97%
4Claude Fable 5.165.83%
5Claude Opus 563.67%
6GPT-6 Astra63.13%
7Claude Fable 561.39%
8GPT-6.1 Sol61.15%
9Muse Spark 1.3 Max58.16%
10GPT-5.6 Sol58.01%
11GPT-6 Sol57.54%
12MiMo V2.6 Pro55.20%
13Claude Opus 4.855.10%
14Grok 4.754.95%
15Gemini 3.8 Flash54.83%
16GLM 5.353.51%
17MiMo-V2.6-Flash53.23%
18Muse Spark 1 353.20%
19GPT-5.6 Terra53.09%
20Grok 4.652.09%
21Claude Sonnet 551.77%
22GPT-5.6 Luna51.69%
23DeepSeek V4.1 Flash51.32%
24Gemini 3.7 Flash51.27%
25GPT-6 Luna51.22%
26Kimi K350.70%
27Hunyuan Hy4 Preview49.94%
28Muse Spark 1.249.29%
29Qwen3.8 Max48.27%
30Deepseek V4 Flash 073147.96%
31DeepSeek V4 Pro47.63%
32Gemini 3.5 Flash44.79%
33Grok 4.544.72%
34Deepseek V4 Pro38.63%
35MiniMax M336.53%
36Mimo V2.5 Pro33.84%
37Gemini 3.1 Pro33.44%
38Gpt 5.4 Mini 2026 03 1733.17%
39Inkling28.67%
40Inkling Small25.46%
41Mercury 2.58.86%

The same model, two sources

Independent and vendor figures for the same model, widest gap first. Run settings differ.

ModelIndependentAs publishedGapPublisher
Claude Fable 5.165.83%65.80%-0.03%Google DeepMind
Claude Opus 5.566.97%67.00%+0.03%Google DeepMind
GPT-6 Astra63.13%63.10%-0.03%Google DeepMind
Gemini 4 Argon68.90%68.90%0.00%Google DeepMind
Gap is the publisher’s figure minus the independent one, in this benchmark’s own points. Both numbers stay visible: averaging them would invent a figure nobody published.

No published result tracked

13 of the 46 models on this site have no published number on this benchmark, so their cells in the home table stay blank rather than reading as zero.

Read this with

Benchmarks in the same category, which usually disagree with this one on purpose.

As reported by each publisher

The same benchmark, measured by the labs themselves. Compare down a column, never across two publishers.

Google DeepMind

Gemini 4 Argon: model evaluation · October 2026

RankModelScore
1Gemini 4 Argon68.9%
4GPT-6 Astra63.1%
3Claude Fable 5.165.8%
2Claude Opus 5.567.0%

Ranks compare reported scores in the same published row; ties share a rank.

Vals Index. Quoted by Google from Vals AI.

Page 5 of Google DeepMind’s model evaluation, read 1 October 2026. Gemini runs use the API at the highest thinking setting, generally pass@1 without majority voting or parallel test-time compute; smaller benchmarks average multiple trials. Other models use their highest available published reasoning results. Google quotes Vals AI for knowledge-work and Vibe Code results, Zapier’s private-set AutomationBench leaderboard, Proximal for FrontierSWE v2, Surge AI for RiemannBench and no-tools Chartography, and the CWE-bench v1 leaderboard. Argon’s DeepSWE uses mini-swe; Terminal-Bench 4.0 is self-computed for Argon and quoted from the author board for other models. PostTrainBench v1.1 uses OpenCode with one H100 and a 10-hour budget for all models. Terminal-Bench Science uses a 6x verifier timeout for Argon. LABBench 2 uses terminal, bioinformatics tools, Python, R and internet access for all models. GraphWalks uses BFS F1 on two separate subsets: 650 items up to 128k tokens and 200 items from 256k to 1M. Agent’s Last Exam uses ALE-Claw, a 5-hour window and binary pass rate, with safety filters enabled for Argon. OSWorld 2.0 uses offline partial reward, the best of three single-attempt runs for Argon, safety filters, 1080p, 500 steps, Gemini CUA with parallel batch tools and compaction, screenshot-only observation and the 08.08 patch; Claude’s combined online/offline results are omitted. LVBench runs without tools, using 1 FPS for Gemini, 800 frames for Astra, 300 for Fable and 600 for Opus. Missing cells remain blank. These are the report’s published figures, preserved separately from this site’s independent source snapshots.

storage.googleapis.com/deepmind-media/gemini/gemini_4_argon_model_evaluation.pdf

Sources

Every page used for this benchmark, read on 17 October 2026.