AIEvals

Benchmarks

Toolathlon Verified

General tool use in realistic environments: more than six hundred tools drawn from software people actually use, with every task requiring a long sequence of calls rather than a single one.

Agentic toolingHKUST NLP (Toolathlon), ICLR 2026Vendor-reported onlyReported by Z.ai

How it is run

The Verified release is the reviewed final version: prompts, ground truths and evaluators were re-checked together, and the trajectories the benchmark ran are published for inspection. Z.ai reports eight models on this release in one table, all measured in the same harness.

What it cannot tell you

Verified is a version, not a quality mark for other releases: numbers from earlier Toolathlon tables are not comparable with these. Everything on this page comes from one publisher, so the ordering inside its column is meaningful while a gap between two columns is not.

Why there is no independent table

No independent suite in this dataset runs Toolathlon Verified. The numbers below are the ones model publishers report about their own models, which is a different kind of evidence: each publisher chooses its own harness and effort level, so a row is readable on its own and not against the other rows.

Read this with

Benchmarks in the same category, which usually disagree with this one on purpose.

As reported by each publisher

Kept separate per publisher, because the settings are not shared.

Z.ai

GLM-5.3: Frontier Coding with Emergent Cyber Capabilities — evaluation table · 14 August 2026

RankModelScore
6GLM 5.373.0%
8GLM 5.259.9%
1Kimi K376.5%
5DeepSeek V4 Pro74.1%
7Qwen3.8 Max72.5%
2Claude Opus 4.876.2%
4Claude Fable 574.7%
3GPT-5.6 Sol74.9%

Ranks compare reported scores in the same published row; ties share a rank.

The comparison table Z.ai publishes with GLM-5.3, read on the model card itself. Z.ai states that GLM-5.3 uses the same base model as GLM-5.2 and that every gain comes from post-training, so the GLM-5.2 column is the same architecture one training round earlier. Column names were restated in the form this site uses, and Z.ai labels its own Fable column "Fable 5 (w/ fallback)", which is recorded here as Claude Fable 5 and is the only column whose runs used a fallback model. Rows whose scale is not a percentage keep their own unit: ExploitGym is reported as tasks completed with a 2-hour and a 6-hour budget and is split into two rows so both numbers stay readable, and GDPval-AA v2 is a score rather than a percentage. The table is the only source for several benchmarks on this site, and nothing in it is an independent run.

z.ai/blog/glm-5.3

Sources

Every page used for this benchmark, read on 17 October 2026.