BenchmarksFrontier Finance

Frontier Finance

Financial research and reasoning with an agent harness. The source reports this configuration separately from other tasks and settings.

Agentic workRecipe not catalogued

Test definition

Author / evaluator
Reported by Moonshot AI
Version / family
Frontier Finance / Frontier Finance
Evidence available
6 results in 1 comparison groups
How the test is scored

Official finance agent v2 harness. Moonshot-reported finance workflow results.

Comparison notes

Publisher-reported results, read 24 October 2026. Compare reported values only within the same source row; tool settings, subsets, versions, judges and metrics must not be combined.

A different task split, tool policy, judge or reasoning effort can change the result. Choose one comparison group below.

Results by evaluator

Select a publication and metric to compare the recorded field.

selfKimi K3.1 Pro: complete release evaluation · Frontier Finance

self% · Higher is better
  1. 1Claude Fable 5.160.8%
  2. 2Kimi K3.1 Pro58.6%
  3. 3GLM 5.357.5%
  4. 4Claude Opus 5.556.7%
  5. 5DeepSeek V4.1 Flash 101754.5%
  6. 6GPT-6 Astra45.0%

Bars start at zero. 6 reported results in this comparison group; ties share a rank. Source ↗

All observations

Every numeric result, with its source and reported run conditions.

6 results

Results (%)
ModelResult (%)SourceRun
Kimi K3.1 Pro58.6self
Details

Official finance agent v2 harness. Moonshot-reported finance workflow results. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
Frontier Finance
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
Claude Fable 5.160.8self
Details

Official finance agent v2 harness. Moonshot-reported finance workflow results. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
Frontier Finance
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
GPT-6 Astra45.0self
Details

Official finance agent v2 harness. Moonshot-reported finance workflow results. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
Frontier Finance
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
Claude Opus 5.556.7self
Details

Official finance agent v2 harness. Moonshot-reported finance workflow results. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
Frontier Finance
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
DeepSeek V4.1 Flash 101754.5self
Details

Official finance agent v2 harness. Moonshot-reported finance workflow results. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
Frontier Finance
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
GLM 5.357.5self
Details

Official finance agent v2 harness. Moonshot-reported finance workflow results. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
Frontier Finance
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →

Reproduction

Recipe not catalogued

Public execution instructions have not been verified in this catalogue. This status does not claim that the benchmark is closed or impossible to run.

Execution documentation ↗
Build a run plan →