AA-Omniscience
Factual recall and hallucination across economically relevant domains.
Factual knowledgeReported independently by Artificial Analysis383 models run by Artificial AnalysisUpdated 8 October 2026
How it is run
AA reports a knowledge and hallucination score, not a percent-correct figure. Incorrect answers are penalized; values can be negative. Highest published effort per release; the table retains its snapshot date.
What it cannot tell you
Effort settings and evaluation versions matter. These source-specific results are kept separate from Vals AI and vendor reports. A missing score stays blank.
- Leader
- Claude Opus 5.546.42 · Artificial Analysis results, grouped here by release
- Top-ten spread
- 14.54Leader minus tenth place, or last place in smaller fields.
- Median
- -40.98of the 383 rows published
- No published result
- 4of 46 models on this site
Artificial Analysis results by release
Highest published effort per model release, grouped here from AA’s public results. Grouping ranks are derived here; source settings and model-publisher reports stay separate.
| # | Model | Score | Effort |
|---|---|---|---|
| 1 | Claude Opus 5.5 | 46.42 | max |
| 2 | Claude Fable 5.1 | 43.45 | max |
| 3 | GPT-6 Astra | 43.4 | max |
| 4 | Claude Fable 5 | 43.3 | max |
| 5 | Gemini 4 Argon | 42.35 | high |
| 6 | GPT-6.1 Sol | 41.53 | max |
| 7 | Claude Opus 5 | 37.07 | max |
| 8 | Claude Sonnet 5.5 | 32.3 | max |
| 9 | Grok 4.7 | 32.03 | xhigh |
| 10 | Gemini 3.1 Pro Preview | 31.88 | Not specified |
| 11 | Gemini 3.8 Flash | 29.55 | high |
| 12 | Grok 4.6 | 29.32 | xhigh |
| 13 | Claude Opus 4.8 | 28.75 | max |
| 14 | Muse Spark 1.1 | 28.08 | xhigh |
| 15 | Claude Opus 4.7 | 27.27 | max |
| 16 | Muse Spark 1.2 | 27.2 | xhigh |
| 17 | GPT-6 Sol | 27.12 | max |
| 18 | Gemini 3.7 Flash | 26.48 | high |
| 19 | Grok 4.5 | 25.32 | high |
| 20 | Muse Spark 1.3 | 25 | max |
| 21 | Gemini 3.6 Flash | 22.13 | high |
| 22 | GPT-5.6 Sol | 21.97 | max |
| 23 | Gemini 3.5 Flash | 21.18 | high |
| 24 | JT-4.1 Flash 236B A21B | 20.57 | Not specified |
| 25 | GPT-5.5 | 20.52 | xhigh |
| 26 | Kimi K3 | 19.7 | max |
| 27 | Grok 4.3 | 17.98 | high |
| 28 | Claude Sonnet 5 | 16.45 | max |
| 29 | Step 5 Preview | 16.38 | Not specified |
| 30 | Gemini 3 Pro Preview | 15.28 | high |
| 31 | GLM-5.3 | 14.3 | max |
| 32 | Claude Opus 4.5 | 14 | Not specified |
| 33 | Claude Opus 4.6 | 13.67 | max |
| 34 | Qwen3.7 Max | 13.48 | Not specified |
| 35 | Grok 4.20 0309 | 12.95 | Not specified |
| 36 | Claude Sonnet 4.6 | 12.22 | max |
| 37 | Qwen3.8 Max (0902) | 11.98 | Not specified |
| 38 | GPT-5.5 Instant (May 2026) | 11.15 | Not specified |
| 39 | GPT-5.3 Codex | 10.87 | xhigh |
| 40 | Claude Haiku 5.5 | 10.67 | max |
| 41 | Motif 3 | 10.18 | Not specified |
| 42 | Qwen3.6 Max Preview | 9.17 | Not specified |
| 43 | MiMo-V2.6-Pro | 8.38 | Not specified |
| 44 | GLM 5.3 Flash | 7.47 | max |
| 45 | Muse Spark | 7.17 | Not specified |
| 46 | Grok Build 0.1 0616 | 6.37 | Not specified |
| 47 | GPT-5.4 | 5.78 | xhigh |
| 48 | GPT-5.1 | 5.4 | high |
| 49 | Kimi K2.6 | 5.3 | Not specified |
| 50 | Gemini 3.5 Flash-Lite | 5.23 | high |
| 51 | MiMo-V2-Pro | 4.62 | Not specified |
| 52 | GLM-5.2 | 4.43 | max |
| 53 | Qwen3.8 2.4T A95B | 4.32 | Not specified |
| 54 | G9v3-39A5B | 3.77 | Not specified |
| 55 | GPT-5.5 Instant (June 2026) | 3.7 | Not specified |
| 56 | Qwen3.8 Max | 3.4 | Not specified |
| 57 | MiMo-V2.5-Pro | 3.25 | Not specified |
| 58 | Grok 4 | 2.1 | Not specified |
| 59 | Inkling | 2 | xhigh |
| 60 | MiniMax-M3 | 1.35 | Not specified |
| 61 | Qwen3.7 Plus | 1.08 | Not specified |
| 62 | Qwen3.6 Plus | 0.88 | Not specified |
| 63 | GLM-5.1 | 0.85 | Not specified |
| 64 | DeepSeek V4 Pro 0813 | 0.83 | max |
| 65 | MiniMax-M2.7 | 0.77 | Not specified |
| 66 | GPT-6 Luna | 0.65 | max |
| 67 | GLM-5 | 0.27 | Not specified |
| 68 | Claude 4 Sonnet | 0.17 | Not specified |
| 69 | GPT-5.6 Terra | 0.05 | max |
| 70 | Claude 4.5 Sonnet | -0.08 | Not specified |
| 71 | Nemotron 3 Ultra 550B A55B | -0.4 | Not specified |
| 72 | Claude 3.7 Sonnet | -0.73 | Not specified |
| 73 | Solar Pro 4 | -0.85 | Not specified |
| 74 | GPT-5.2 | -0.88 | xhigh |
| 75 | Solar Open2 250B | -1.77 | Not specified |
| 76 | GPT-5.2 Codex | -2.17 | xhigh |
| 77 | Quasar 438B | -2.6 | max |
| 78 | K2 Horizon 375B A23B | -2.97 | Not specified |
| 79 | Command A+ | -4.02 | Not specified |
| 80 | Gemini 3 Flash Preview | -4.32 | Not specified |
| 81 | G9v3-3B | -4.37 | Not specified |
| 81 | Claude 4.5 Haiku | -4.37 | Not specified |
| 83 | Ling-3.0-flash-VL | -4.53 | Not specified |
| 84 | DeepSeek V4.1 Flash | -5.3 | max |
| 85 | GPT-5.1 Codex | -6.5 | high |
| 86 | K-EXAONE 2.0 0803 | -6.6 | Not specified |
| 87 | Grok 3 mini Reasoning | -6.8 | high |
| 88 | Kimi K2.5 | -7.33 | Not specified |
| 89 | GPT-5 Codex | -7.53 | high |
| 90 | A.X-K2 | -8.23 | Not specified |
| 91 | GPT-5 | -8.73 | high |
| 92 | Inkling Small | -8.93 | Not specified |
| 93 | Qwen3.8-Flash-Next | -9.72 | Not specified |
| 94 | MiMo-V2.5 | -9.83 | Not specified |
| 95 | Qwen3.8 27B | -9.98 | xhigh |
| 96 | Kimi K2.7 Code | -10.22 | Not specified |
| 97 | GPT-5.6 Luna | -10.28 | max |
| 98 | GPT-4o (Nov '24) | -10.52 | Not specified |
| 99 | DeepSeek V4 Pro 0424 | -10.73 | max |
| 100 | Solar Mini 4 | -10.82 | Not specified |
| 101 | K2 Horizon MoVA 36B A4B | -10.95 | Not specified |
| 101 | LFM2.5-2.6B | -10.95 | Not specified |
| 103 | o1 | -11.05 | Not specified |
| 104 | MiniCPM5-2B | -11.65 | Not specified |
| 105 | MiMo-V2.6-Flash | -12.68 | Not specified |
| 106 | Granite 4.2 30B | -12.92 | Not specified |
| 107 | Qwen3.5 Omni Plus | -13.12 | Not specified |
| 108 | DeepSeek V4 Flash 0731 | -14.28 | max |
| 109 | Ling-3.0-flash-Fin | -14.58 | Not specified |
| 110 | MiniCPM5-1B | -14.62 | Not specified |
| 111 | Granite 4.2 3B | -14.72 | Not specified |
| 112 | MiMo-V2-Omni-0327 | -15.1 | Not specified |
| 113 | o3 | -15.55 | Not specified |
| 114 | Gemini 2.5 Pro | -16.35 | Not specified |
| 115 | GLM-5-Turbo | -16.37 | Not specified |
| 116 | Gemini 3.1 Flash-Lite | -16.42 | high |
| 116 | GPT-5.1 Codex mini | -16.42 | high |
| 118 | K2 Horizon 7B | -16.57 | Not specified |
| 119 | Llama 3.1 Instruct 405B | -17.1 | Not specified |
| 120 | Granite 4.2 8B | -17.17 | Not specified |
| 121 | GPT-5 mini | -17.32 | high |
| 122 | DeepSeek V4 Flash Vision | -17.63 | max |
| 123 | Nemotron 3.5 Lightning | -17.72 | Not specified |
| 123 | DeepSeek V3.2 Speciale | -17.72 | Not specified |
| 125 | Motif 3 (Beta) | -17.77 | Not specified |
| 126 | Ling 3.0 Flash | -17.88 | Not specified |
| 127 | Hy3 | -18.47 | Not specified |
| 128 | GPT-5.4 mini | -18.92 | xhigh |
| 129 | MiMo-V2-Flash (Feb 2026) | -19.05 | Not specified |
| 130 | GLM 5V Turbo | -19.28 | Not specified |
| 131 | Ling 3.0 Tiny | -19.35 | Not specified |
| 132 | MiMo-V2-Omni | -20.13 | Not specified |
| 133 | GPT-4o (Aug '24) | -20.87 | Not specified |
| 134 | Kimi K2 Thinking | -21.42 | Not specified |
| 135 | Apodex 1.1 | -21.9 | Not specified |
| 136 | Qwen3 Coder 480B A35B Instruct | -22.2 | Not specified |
| 137 | KAT Coder Pro V2 | -22.47 | Not specified |
| 138 | Claude 3.5 Haiku | -22.52 | Not specified |
| 139 | LongCat 2.0 | -23.42 | Not specified |
| 140 | DeepSeek V4 Flash 0420 | -23.9 | max |
| 141 | JT-35B-Flash | -24.22 | Not specified |
| 142 | Cogito v2.1 | -25.78 | Not specified |
| 143 | DeepSeek V3.1 Terminus | -26.4 | Not specified |
| 144 | Kimi K2 0905 | -26.58 | Not specified |
| 145 | Magistral Medium 1.2 | -26.73 | Not specified |
| 146 | Magistral Medium 1 | -26.93 | Not specified |
| 147 | Nex-N2-Pro | -27.05 | Not specified |
| 148 | GLM-4.5 | -27.38 | Not specified |
| 149 | DeepSeek R1 0528 (May '25) | -27.43 | Not specified |
| 150 | Kimi K2 | -28.32 | Not specified |
| 151 | K2 Horizon 3.7B | -28.62 | Not specified |
| 152 | GPT-5 nano | -28.67 | high |
| 153 | Gemma 3 270M | -29.27 | Not specified |
| 154 | GPT-5.4 nano | -29.47 | xhigh |
| 155 | DeepSeek V3.1 | -29.58 | Not specified |
| 156 | Gemini 2.5 Flash | -29.8 | Not specified |
| 157 | Grok 4.1 Fast | -29.92 | Not specified |
| 158 | Qwen3.5 397B A17B | -30.75 | Not specified |
| 159 | Llama 3.1 Instruct 8B | -30.88 | Not specified |
| 160 | Mistral Medium 3 | -31.4 | Not specified |
| 161 | Devstral Medium | -31.57 | Not specified |
| 162 | DeepSeek R1 (Jan '25) | -32.22 | Not specified |
| 163 | Muse Glimmer | -32.85 | high |
| 164 | MiniMax-M2.1 | -32.87 | Not specified |
| 165 | Grok 3 | -33.18 | Not specified |
| 166 | LFM2.5-8B-A1B | -33.2 | Not specified |
| 167 | GPT-4 | -33.83 | Not specified |
| 168 | Mistral Large 2 (Nov '24) | -34.37 | Not specified |
| 169 | Hy3-preview | -35.05 | Not specified |
| 170 | ERNIE 4.5 300B A47B | -35.13 | Not specified |
| 171 | Doubao Seed Code | -35.2 | Not specified |
| 172 | Nova Premier | -35.38 | Not specified |
| 173 | o4-mini | -35.7 | high |
| 174 | Hermes 4 - Llama-3.1 405B | -36.02 | Not specified |
| 175 | GLM-4.7 | -36.43 | Not specified |
| 176 | Qwen3 Max Thinking | -36.62 | Not specified |
| 177 | Mistral Medium 3.5 | -36.8 | high |
| 178 | Grok Code Fast 1 | -37.07 | Not specified |
| 179 | Step 3.7 Flash | -37.28 | high |
| 180 | GLM-4.6V | -37.63 | Not specified |
| 181 | Ring-2.6-1T | -37.7 | xhigh |
| 182 | KAT-Coder-Pro V1 | -37.73 | Not specified |
| 183 | MiniMax-M2.5 | -38.87 | Not specified |
| 184 | Qwen3 Max Thinking (Preview) | -39.12 | Not specified |
| 185 | Mercury 2.5 | -39.48 | Not specified |
| 186 | Mistral Large 3 | -39.57 | Not specified |
| 187 | GPT-4.1 | -39.63 | Not specified |
| 188 | Gemini 2.5 Flash Preview (Sep '25) | -39.9 | Not specified |
| 189 | K2 Think V2 | -40.33 | high |
| 190 | DeepSeek V3 0324 | -40.67 | Not specified |
| 191 | Llama 3.1 Nemotron Instruct 70B | -40.83 | Not specified |
| 192 | Gemma 4 E4B | -40.98 | Not specified |
| 193 | Nemotron 3 Super 120B A12B | -41.5 | Not specified |
| 194 | DeepSeek V3 (Dec '24) | -41.65 | Not specified |
| 195 | Step 3.5 Flash | -41.82 | Not specified |
| 196 | Llama 4 Maverick | -41.85 | Not specified |
| 197 | GLM-4.6 | -41.88 | Not specified |
| 198 | Nova Lite | -42.17 | Not specified |
| 199 | Nanbeige4.1-3B | -42.5 | Not specified |
| 200 | Gemini 2.0 Flash (Feb '25) | -42.53 | Not specified |
| 201 | o3-mini | -42.57 | high |
| 201 | Gemini 2.5 Flash-Lite Preview (Sep '25) | -42.57 | Not specified |
| 203 | Qwen3 Max (Preview) | -42.78 | Not specified |
| 204 | Llama 3.1 Instruct 70B | -43.1 | Not specified |
| 205 | Olmo 3.1 32B Think | -43.37 | Not specified |
| 206 | Qwen3 Max | -43.55 | Not specified |
| 207 | Qwen3.5 27B | -43.98 | Not specified |
| 207 | Qwen3 235B A22B 2507 Instruct | -43.98 | Not specified |
| 209 | Trinity Large Thinking | -44.07 | Not specified |
| 210 | Step 3.5 Flash 2603 | -44.22 | Not specified |
| 211 | Magistral Small 1 | -44.4 | Not specified |
| 212 | Grok 4.20 0309 v2 | -44.63 | Not specified |
| 213 | Llama 3.1 Nemotron Ultra 253B v1 | -44.87 | Not specified |
| 214 | ERNIE 5.0 Thinking Preview | -45.62 | Not specified |
| 215 | Llama Nemotron Super 49B v1.5 | -46.18 | Not specified |
| 216 | Mistral Medium 3.1 | -46.28 | Not specified |
| 217 | DeepSeek R1 Distill Llama 70B | -46.38 | Not specified |
| 218 | Qwen3 235B A22B 2507 (Reasoning) | -46.52 | Not specified |
| 219 | Qwen3 VL 235B A22B (Reasoning) | -46.55 | Not specified |
| 219 | MiniMax-M2 | -46.55 | Not specified |
| 221 | Devstral 2 | -46.7 | Not specified |
| 222 | DeepSeek V3.2 | -46.88 | Not specified |
| 223 | Nova Pro | -47.73 | Not specified |
| 224 | Gemma 4 31B | -47.93 | Not specified |
| 225 | Qwen3.5 35B A3B | -48.1 | Not specified |
| 226 | DeepSeek V3.2 Exp | -48.2 | Not specified |
| 227 | Command A | -48.27 | Not specified |
| 228 | MiMo-V2-Flash | -48.45 | Not specified |
| 229 | MiniMax M1 80k | -48.5 | Not specified |
| 230 | Mistral Small 4 | -48.52 | Not specified |
| 230 | Nova Micro | -48.52 | Not specified |
| 232 | North Mini Code | -48.58 | Not specified |
| 232 | Hermes 4 - Llama-3.1 70B | -48.58 | Not specified |
| 234 | Claude 3 Haiku | -48.63 | Not specified |
| 235 | Qwen3 14B | -48.95 | Not specified |
| 236 | Nova 2.0 Pro Preview | -49.05 | medium |
| 237 | gpt-oss-120b | -49.25 | high |
| 238 | Qwen3 32B | -50.37 | Not specified |
| 239 | Mistral Small 3.2 | -50.58 | Not specified |
| 240 | Ling-2.6-1T | -50.6 | Not specified |
| 241 | Mercury 2 | -50.72 | high |
| 241 | EXAONE 4.5 33B | -50.72 | Not specified |
| 243 | Qwen3 Coder 30B A3B Instruct | -50.73 | Not specified |
| 244 | Mistral Small 3.1 | -50.75 | Not specified |
| 245 | Gemma 4 26B A4B | -50.83 | Not specified |
| 245 | Devstral Small (Jul '25) | -50.83 | Not specified |
| 247 | INTELLECT-3 | -50.85 | Not specified |
| 248 | Ring-1T | -50.92 | Not specified |
| 249 | Qwen3 Next 80B A3B (Reasoning) | -51.42 | Not specified |
| 250 | Nemotron Cascade 2 30B A3B | -51.47 | Not specified |
| 251 | Qwen3 30B A3B | -51.48 | Not specified |
| 252 | Qwen3 VL 8B Instruct | -51.88 | Not specified |
| 253 | Llama 4 Scout | -52.15 | Not specified |
| 254 | Qwen3 VL 8B (Reasoning) | -52.3 | Not specified |
| 255 | Olmo 3.1 32B Instruct | -52.37 | Not specified |
| 256 | Qwen3 235B A22B | -52.38 | Not specified |
| 257 | Seed-OSS-36B-Instruct | -52.47 | Not specified |
| 258 | Qwen3 VL 32B (Reasoning) | -52.52 | Not specified |
| 259 | Qwen3 VL 235B A22B Instruct | -52.67 | Not specified |
| 260 | Gemma 4 12B | -52.8 | Not specified |
| 261 | Qwen2.5 Instruct 72B | -53.07 | Not specified |
| 262 | Qwen3.6 27B | -53.2 | Not specified |
| 263 | HyperCLOVA X SEED Think (32B) | -53.28 | Not specified |
| 264 | Solar Pro 3 | -53.4 | high |
| 265 | GPT-4.1 mini | -53.57 | Not specified |
| 266 | LFM2 2.6B | -54.07 | Not specified |
| 267 | Llama 3.3 Instruct 70B | -54.17 | Not specified |
| 268 | Llama 3 Instruct 70B | -54.32 | Not specified |
| 269 | Grok 4 Fast | -54.43 | Not specified |
| 270 | Solar Open 100B | -54.5 | high |
| 271 | HyperNova 60B 2605 | -54.58 | high |
| 272 | Llama 3.2 Instruct 1B | -54.7 | Not specified |
| 273 | Apriel-v1.5-15B-Thinker | -54.8 | Not specified |
| 274 | Jamba 1.7 Large | -54.92 | Not specified |
| 275 | Qwen3.5 122B A10B | -54.97 | Not specified |
| 276 | Nova 2.0 Lite | -54.98 | high |
| 277 | Ling-1T | -55.13 | Not specified |
| 278 | GLM-4.5V | -55.58 | Not specified |
| 278 | K2-V2 | -55.58 | high |
| 280 | Phi-4 | -55.7 | Not specified |
| 281 | Solar Pro 2 | -55.88 | high |
| 282 | Qwen3 30B A3B 2507 (Reasoning) | -56.13 | Not specified |
| 283 | Devstral Small (May '25) | -56.78 | Not specified |
| 284 | NVIDIA Nemotron Nano 9B V2 | -57.25 | Not specified |
| 285 | Nemotron 3 Nano Omni 30B A3B Reasoning | -57.43 | Not specified |
| 286 | GPT-4.1 nano | -57.58 | Not specified |
| 287 | Qwen3 VL 30B A3B (Reasoning) | -57.63 | Not specified |
| 288 | Devstral Small 2 | -57.7 | Not specified |
| 289 | Jamba Reasoning 3B | -57.72 | Not specified |
| 290 | K-EXAONE | -57.97 | Not specified |
| 291 | Olmo 3 32B Think | -58.07 | Not specified |
| 292 | LFM2 24B A2B | -58.1 | Not specified |
| 293 | Llama 3.3 Nemotron Super 49B v1 | -58.3 | Not specified |
| 294 | Ring-flash-2.0 | -58.62 | Not specified |
| 295 | Gemini 2.5 Flash-Lite | -58.78 | Not specified |
| 296 | Step3 VL 10B | -59 | Not specified |
| 297 | Nova 2.0 Omni | -59.08 | medium |
| 298 | Mi:dm K 2.5 Pro | -59.18 | Not specified |
| 299 | DiffusionGemma 26B A4B | -59.23 | Not specified |
| 300 | Apriel-v1.6-15B-Thinker | -59.37 | Not specified |
| 301 | Sarvam 105B | -59.38 | high |
| 302 | Qwen3 Next 80B A3B Instruct | -59.5 | Not specified |
| 303 | Qwen3.6 35B A3B | -60.02 | Not specified |
| 304 | Gemma 4 E2B | -60.18 | Not specified |
| 305 | Qwen3 4B 2507 (Reasoning) | -60.27 | Not specified |
| 306 | Granite 4.0 H Small | -61.02 | Not specified |
| 307 | Phi-4 Mini Instruct | -61.08 | Not specified |
| 308 | Falcon-H1R-7B | -61.3 | Not specified |
| 309 | Qwen3 Omni 30B A3B (Reasoning) | -61.4 | Not specified |
| 310 | GLM-4.5-Air | -61.53 | Not specified |
| 311 | Apertus 70B Instruct | -61.55 | Not specified |
| 312 | Sarvam M | -61.6 | high |
| 313 | Motif-2-12.7B-Reasoning | -61.68 | Not specified |
| 314 | Qwen3 4B 2507 Instruct | -61.93 | Not specified |
| 315 | Tri-21B-think Preview | -62.3 | Not specified |
| 316 | Qwen3 Coder Next | -62.4 | Not specified |
| 317 | Tri-21B-Think | -62.55 | Not specified |
| 318 | Llama 3.2 Instruct 11B (Vision) | -62.6 | Not specified |
| 319 | GLM-4.7-Flash | -62.62 | Not specified |
| 320 | Ling-flash-2.0 | -62.7 | Not specified |
| 321 | Mi:dm K 2.5 Pro Preview | -62.73 | Not specified |
| 322 | EXAONE 4.0 32B | -62.77 | Not specified |
| 323 | gpt-oss-20b | -63.05 | high |
| 324 | Qwen3 VL 32B Instruct | -63.37 | Not specified |
| 325 | Qwen3 VL 30B A3B Instruct | -63.42 | Not specified |
| 326 | DeepSeek R1 0528 Qwen3 8B | -63.62 | Not specified |
| 327 | Ministral 3 3B | -64 | Not specified |
| 328 | JT-MINI | -64.1 | Not specified |
| 329 | Granite 4.1 8B | -64.12 | Not specified |
| 330 | NVIDIA Nemotron Nano 12B v2 VL | -64.23 | Not specified |
| 331 | Qwen3 8B | -64.73 | Not specified |
| 332 | Mistral 7B Instruct | -64.92 | Not specified |
| 333 | Qwen3.5 Omni Flash | -65.07 | Not specified |
| 334 | Magistral Small 1.2 | -65.1 | Not specified |
| 335 | Reka Flash 3 | -65.13 | Not specified |
| 336 | Ling 2.6 Flash | -66.13 | Not specified |
| 337 | Qwen3 30B A3B 2507 Instruct | -66.15 | Not specified |
| 338 | Ministral 3 14B | -66.37 | Not specified |
| 339 | Gemma 3 27B Instruct | -67.22 | Not specified |
| 340 | Granite 4.1 30B | -67.78 | Not specified |
| 341 | Qwen3 VL 4B (Reasoning) | -68.38 | Not specified |
| 342 | Ministral 3 8B | -68.95 | Not specified |
| 343 | Molmo2-8B | -69.22 | Not specified |
| 344 | Qwen3 Omni 30B A3B Instruct | -69.27 | Not specified |
| 345 | NVIDIA Nemotron 3 Nano 30B A3B | -69.3 | Not specified |
| 346 | Granite 4.0 350M | -69.35 | Not specified |
| 347 | LongCat Flash Lite | -70.07 | Not specified |
| 348 | Llama 3 Instruct 8B | -70.12 | Not specified |
| 349 | NVIDIA Nemotron 3 Nano 4B | -70.53 | Not specified |
| 350 | Qwen3.5 9B | -70.7 | Not specified |
| 351 | Sarvam 30B | -71.52 | high |
| 352 | Celeris-1 | -71.58 | Not specified |
| 353 | Olmo 3 7B Think | -71.8 | Not specified |
| 354 | LFM2.5-1.2B-Instruct | -72.1 | Not specified |
| 355 | Granite 4.0 H 1B | -72.27 | Not specified |
| 356 | LFM2 1.2B | -72.43 | Not specified |
| 357 | K2 Horizon 0.9B | -72.82 | Not specified |
| 358 | Jamba 1.7 Mini | -73.12 | Not specified |
| 359 | Qwen3.5 4B | -74.73 | Not specified |
| 360 | Gemma 3 1B Instruct | -75.45 | Not specified |
| 361 | Qwen3 VL 4B Instruct | -75.97 | Not specified |
| 362 | LFM2 8B A1B | -76.5 | Not specified |
| 363 | Granite 4.1 3B | -77.03 | Not specified |
| 364 | Gemma 3 12B Instruct | -77.07 | Not specified |
| 364 | Olmo 3 7B Instruct | -77.07 | Not specified |
| 366 | Apertus 8B Instruct | -77.22 | Not specified |
| 367 | Granite 3.3 8B | -77.28 | Not specified |
| 368 | Granite 4.0 Micro | -77.53 | Not specified |
| 369 | Ling-mini-2.0 | -78.47 | Not specified |
| 370 | LFM2.5-1.2B-Thinking | -79.95 | Not specified |
| 371 | Gemma 3n E2B Instruct | -80.17 | Not specified |
| 372 | Granite 4.0 H 350M | -80.92 | Not specified |
| 373 | Gemma 3n E4B Instruct | -81.33 | Not specified |
| 374 | Granite 4.0 1B | -81.62 | Not specified |
| 375 | Exaone 4.0 1.2B | -82.15 | Not specified |
| 376 | MiniCPM-V 4.6 1.3B | -82.87 | Not specified |
| 377 | Gemma 3 4B Instruct | -82.88 | Not specified |
| 378 | Qwen3.5 2B | -83.13 | Not specified |
| 379 | Qwen3 1.7B | -84.08 | Not specified |
| 380 | Tiny Aya Global | -84.3 | Not specified |
| 381 | LFM2.5-VL-1.6B | -84.42 | Not specified |
| 382 | Qwen3 0.6B | -84.95 | Not specified |
| 383 | Qwen3.5 0.8B | -88.58 | Not specified |
No published result tracked
4 of the 46 models on this site have no published number on this benchmark, so their cells in the home table stay blank rather than reading as zero.
Read this with
Other versions of the same evaluation. Versions are not comparable: the task set changes between them.
Sources
Every page used for this benchmark, read on 17 October 2026.
- Benchmark site or the page that publishes itartificialanalysis.ai/evaluations/omniscience
- Independent resultsartificialanalysis.ai/evaluations/omniscience