Sources and method

Independent results come from Vals AI, Artificial Analysis, Datacurve, ARC Prize · Standard and Scale AI / SEAL: results retain each source’s task set and run settings. Compare scores within the same column.

Vendor tables are reproduced from the announcement in which each lab published them, including the columns that lab chose and the models it chose to compare against. That is why they sit in separate tables: a lab's own run and an independent run answer different questions.

Model specifications — release date, context window, maximum output, list price and whether weights are open — are read from the source listed on each model page, with evaluator-recorded prices identified in its summary. Prices are in US dollars per million tokens and exclude caching, batch and committed-use discounts.

Hosted-run facts — the capabilities a runtime advertises, its own context cap, its parameter count and its per-token prices — are read from the runtime's own model page and labelled as that runtime's figures, because the version a caller reaches and the model a lab describes are not always the same build. Where the two disagree, both are printed.

Derived views — the ranks, field spreads, medians and lab standings shown on Rankings and on each page — are computed from the tables above at build time, never stored. A rank is claimed only inside a field this site can see, and no figure is ever averaged across two publishers.

• It does not run models, and it has no independent measurements of its own.
• It does not average vendor claims together or reconcile disagreements between publishers.
• It does not rank models by a single composite score, or claim that a higher number means a better product.
• It does not estimate a missing value; a blank means no published result is present in the sources tracked.
• It does not claim a rank outside the rows it read: where a suite scores hundreds of models, this site ranks only the models it lists and says so on the page.

Send corrections through the support link in the footer. Corrections are checked against the published source.