AIEvals

Benchmarks

LegalBench

Legal reasoning tasks assembled from published legal benchmarks, including statutory reasoning and contract analysis.

Professional knowledgeStanford Hazy Research149 models run by Vals AIUpdated 29 September 2026Reported by Z.ai

How it is run

148 runs scored in the independent suite, spanning many model generations.

What it cannot tell you

General legal reasoning is not legal practice. No benchmark here tests jurisdiction-specific advice, and none should be read as a compliance opinion.

Leader
Claude Fable 588.56% · Vals AI's own list
Top-ten spread
1.70%Leader minus tenth place, or last place in smaller fields.
Median
82.06%of the 149 rows published
No published result
19of 46 models on this site

Independent leaderboard · Vals AI

Top 149 of 149 runs by Vals AI, one harness.

#ModelScore
1Claude Fable 588.56%
2Claude Fable 5.188.51%
3Gemini 4 Argon88.30%
4Gemini 3.1 Pro87.40%
5Gemini 3.7 Flash87.26%
6Gemini 3 Pro Preview87.03%
7Gemini 3.8 Flash86.99%
8Claude Opus 586.97%
8GPT-5.6 Sol86.97%
10Gemini 3 Flash Preview86.86%
11Gemini 3.6 Flash86.70%
12GPT-5.586.52%
13Grok 4.686.31%
14Gpt 5.4 2026 03 0586.04%
15Gpt 5 2025 08 0786.02%
15Kimi K386.02%
17Grok 4.585.97%
18Gpt 5.1 2025 11 1385.68%
19MiniMax M385.42%
20Claude Opus 4 6 Thinking85.30%
21Muse Spark 1.285.26%
22Claude Opus 4.785.25%
23GPT-5.6 Terra85.11%
24Qwen3.5 Plus Thinking85.10%
25Muse Spark 1 184.98%
26Qwen3.7 Max84.91%
27GLM 5.384.84%
28Kimi K2.684.74%
29Claude Opus 4 5 20251101 Thinking84.60%
30Grok 4.384.46%
31Glm 5.184.39%
31Grok 4.784.39%
33Gemini 2.5 Pro Exp 03 2584.32%
34Qwen3.5 Flash84.28%
35Qwen3.6 Plus84.23%
36Muse Spark84.22%
37Claude Sonnet 4 5 20250929 Thinking84.08%
38Gemini 3.5 Flash Lite84.07%
38Glm 5.284.07%
40Glm 5 Thinking84.06%
41GPT-5.6 Luna84.03%
42MiniMax M2.783.98%
43GLM 5.3 Flash83.93%
44Claude Sonnet 583.92%
45Gemini 2.5 Flash Preview 04 1783.80%
46Gemini 3.1 Flash Lite Preview83.76%
46O3 2025 04 1683.76%
46Hunyuan Hy4 Preview83.76%
49Qwen3.8 Max83.61%
50Gemini 3.5 Flash83.60%
51Claude Opus 4.883.57%
52Claude Opus 4 1 2025080583.46%
53Glm 4.783.36%
54DeepSeek V4.1 Flash83.28%
55Grok 4 070983.19%
56Grok 3 Mini Fast High Reasoning83.14%
57Gpt 4.1 2025 04 1483.10%
58Claude Opus 4 2025051483.07%
59Mercury 2.583.06%
60Inkling Small82.99%
61Claude Sonnet 4 2025051482.95%
61Inkling82.95%
63Claude Opus 4 5 2025110182.84%
64Gpt 5.2 2025 12 1182.76%
65Gemini 2.5 Flash Preview 09 2025 Thinking82.63%
66Grok 382.59%
67Claude 3 7 Sonnet 20250219 Thinking82.52%
68Gemini 2.5 Flash Preview 09 202582.49%
69Grok 4 1 Fast Reasoning82.45%
70Qwen3.8 27b82.43%
71DeepSeek V4 Pro82.36%
72Gpt 4o 2024 11 2082.21%
73Claude Sonnet 4 682.12%
74Nemotron 3 Ultra 550b A55b82.07%
75Claude Sonnet 4 20250514 Thinking82.06%
76Gemini 2.5 Flash Lite Preview 09 2025 Thinking82.04%
77Grok 3 Mini Fast Low Reasoning81.92%
78Qwen3 Max81.86%
79Gpt 5 Mini 2025 08 0781.77%
80Kimi K2 Instruct81.45%
81Claude Haiku 4 5 20251001 Thinking81.24%
82Deepseek V380.76%
83Grok 4 Fast Reasoning80.60%
84Gpt 4 Turbo80.46%
85O1 2024 12 1780.39%
86Qwen3 Max Preview80.33%
87Deepseek V4 Pro80.32%
88Kimi K2 Thinking80.20%
89Qwen3 235b A22b80.18%
90Gpt 4o 2024 08 0680.12%
91Claude 3 7 Sonnet 2025021980.00%
92MiniMax M2.579.96%
93Command A 03 202579.70%
94Ling 3.0 Flash 260779.69%
95Glm 4.679.61%
96Qwen2.5 72B Instruct Turbo79.40%
97O4 Mini 2025 04 1679.19%
98Mistral Large 251279.14%
99Grok 4 1 Fast Non Reasoning79.11%
100Gemini 2.5 Flash Lite Preview 09 202579.01%
101Mimo V2.578.89%
102Grok 4 Fast Non Reasoning78.40%
103Gemini 2.0 Flash 00178.36%
104Gpt 4.1 Mini 2025 04 1478.04%
105Gpt 5.4 Nano 2026 03 1777.92%
106Llama4 Maverick Instruct Basic77.81%
107Grok 4.20 0309 Reasoning77.74%
108Deepseek V3 032477.73%
109Deepseek V4 Flash 073177.71%
110Llama 3.3 70B Instruct Turbo77.18%
111Mimo V2.5 Pro77.13%
112Deepseek V3p2 Thinking76.08%
113Gpt Oss 120b75.94%
114Glm 4.575.63%
115MiniMax M2.175.45%
116Laguna M.175.14%
117Jamba 1.5 Large74.16%
118Llama 4 Scout 17B 16E Instruct72.04%
119Jamba Large 1.671.96%
120O3 Mini 2025 01 3171.54%
121Laguna Xs.271.03%
122Gpt Oss 20b70.85%
123Claude 3 5 Haiku 2024102270.33%
124Gemini 1.0 Pro 00270.25%
125Jamba Mini 1.669.73%
126Qwen2.5 7B Instruct Turbo69.56%
127Mistral Small 250369.16%
128Gemini 1.5 Pro 00269.08%
129Ling 3.0 Flash Af Rc368.74%
130Command R Plus68.29%
131Gemma 2 9b It68.14%
132Gemma 2 27b It67.98%
133Deepseek R167.32%
134Jamba 1.5 Mini66.62%
135Deepseek V3p265.96%
136Gpt 3.5 Turbo64.37%
137Gemini 1.5 Flash 00263.24%
138Llama 2 70b Hf62.43%
139Mistral Medium 250561.98%
140Command A Plus 05 202661.42%
141Gpt 4.1 Nano 2025 04 1461.06%
142Mixtral 8x7B V0.155.84%
143Magistral Medium 250954.77%
144Mistral 7B V0.153.77%
145Llama 2 13b53.70%
146Llama 2 7b51.87%
147Gpt 5 Nano 2025 08 0750.13%
148Magistral Small 250940.02%
149Command R32.97%

No published result tracked

19 of the 46 models on this site have no published number on this benchmark, so their cells in the home table stay blank rather than reading as zero.

Read this with

Benchmarks in the same category, which usually disagree with this one on purpose.

As reported by each publisher

The same benchmark, measured by the labs themselves. Compare down a column, never across two publishers.

Z.ai

GLM-Legal: legal benchmark evaluation · 12 October 2026

RankModelScore
3GLM-Legal86.2%
5GLM-5.3-Flash83.9%
3Kimi K386.2%
1Claude Fable 588.6%
2GPT-6 Astra87.1%

Ranks compare reported scores in the same published row; ties share a rank.

LegalBench. The publisher does not specify the task subset or aggregation.

Z.ai’s three-row comparison image, read 13 October 2026. All 15 values retain the published model identities; GLM-5.3-Flash is a comparison column, not GLM 5.3. Harvey LAB is the all-pass rate across 24 practice areas, distinct from criteria pass rate. LegalBench and PLawBench retain the percentages shown in the image; their aggregation, task subsets and judge settings are not specified. Reasoning effort, harness configuration and trial counts are not stated. These are publisher reports, kept separate from independent Vals and Artificial Analysis results. Ranks are derived only within each row, with ties sharing a rank.

z.ai/blog/glm-legal

Sources

Every page used for this benchmark, read on 17 October 2026.