BenchmarksPostTrain Bench v1.2

PostTrain Bench v1.2

Training and improving models under constrained GPU resources.

Agentic codingRecipe not catalogued

Test definition

Author / evaluator
Reported by Moonshot AI
Version / family
PostTrain Bench v1.2 / PostTrain Bench v1.2
Evidence available
6 results in 1 comparison groups
How the test is scored

Kimi and DeepSeek were run internally on v1.2 with Claude Code and H20 GPUs rather than H100s, using DeepSeek 1017 max as judge in place of the official GPT-5.6-Terra xhigh judge. Other scores quote the official board.

Comparison notes

Publisher-reported results, read 24 October 2026. Compare reported values only within the same source row; tool settings, subsets, versions, judges and metrics must not be combined.

A different task split, tool policy, judge or reasoning effort can change the result. Choose one comparison group below.

Results by evaluator

Select a publication and metric to compare the recorded field.

selfKimi K3.1 Pro: complete release evaluation · PostTrain Bench v1.2

self% · Higher is better
  1. 1Claude Fable 5.144.6%
  2. 2Claude Opus 5.543.8%
  3. 3GPT-6 Astra41.9%
  4. 4Kimi K3.1 Pro36.5%
  5. 5GLM 5.334.5%
  6. 6DeepSeek V4.1 Flash 101730.5%

Bars start at zero. 6 reported results in this comparison group; ties share a rank. Source ↗

All observations

Every numeric result, with its source and reported run conditions.

6 results

Results (%)
ModelResult (%)SourceRun
Kimi K3.1 Pro36.5self
Details

Kimi and DeepSeek were run internally on v1.2 with Claude Code and H20 GPUs rather than H100s, using DeepSeek 1017 max as judge in place of the official GPT-5.6-Terra xhigh judge. Other scores quote the official board. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
PostTrain Bench v1.2
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
Claude Fable 5.144.6self
Details

Kimi and DeepSeek were run internally on v1.2 with Claude Code and H20 GPUs rather than H100s, using DeepSeek 1017 max as judge in place of the official GPT-5.6-Terra xhigh judge. Other scores quote the official board. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
PostTrain Bench v1.2
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
GPT-6 Astra41.9self
Details

Kimi and DeepSeek were run internally on v1.2 with Claude Code and H20 GPUs rather than H100s, using DeepSeek 1017 max as judge in place of the official GPT-5.6-Terra xhigh judge. Other scores quote the official board. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
PostTrain Bench v1.2
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
Claude Opus 5.543.8self
Details

Kimi and DeepSeek were run internally on v1.2 with Claude Code and H20 GPUs rather than H100s, using DeepSeek 1017 max as judge in place of the official GPT-5.6-Terra xhigh judge. Other scores quote the official board. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
PostTrain Bench v1.2
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
DeepSeek V4.1 Flash 101730.5self
Details

Kimi and DeepSeek were run internally on v1.2 with Claude Code and H20 GPUs rather than H100s, using DeepSeek 1017 max as judge in place of the official GPT-5.6-Terra xhigh judge. Other scores quote the official board. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
PostTrain Bench v1.2
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →
GLM 5.334.5self
Details

Kimi and DeepSeek were run internally on v1.2 with Claude Code and H20 GPUs rather than H100s, using DeepSeek 1017 max as judge in place of the official GPT-5.6-Terra xhigh judge. Other scores quote the official board. Read 24 October 2026. All 47 source rows and six comparison columns are retained, with text-only HLE and both ZeroBench metrics split explicitly. Kimi uses max reasoning effort, temperature 1.0 and top-p 0.95 unless a row states otherwise; proprietary comparison columns are labelled max with fallback. Comparison figures include quoted external results and mixed harnesses. Missing cells remain null and do not enter ranks. Lower hallucination rates rank first; every other rank compares larger values within the same row. Terminal-Bench Science’s September DeepSeek score is attributed separately according to footnote 2. These publication claims do not populate independent boards. Highspeed has no independently identified results and inherits none of these scores.

Metric
PostTrain Bench v1.2
Published
23 October 2026
Effort
Not reported separately
Tasks / attempts
Unknown / Unknown
Confidence interval
Not reported
Build a reproduction plan →

Reproduction

Recipe not catalogued

Public execution instructions have not been verified in this catalogue. This status does not claim that the benchmark is closed or impossible to run.

Execution documentation ↗
Build a run plan →