Skip to content
Yardstick

Methodology & sources

How this catalogue of 29 models from 12 labs is put together, and what to keep in mind when reading it. Data as of Oct 8, 2026.

Who measured it

Every score is tagged with who produced it. An unmarked number was run by the benchmark’s own maintainer or an independent evaluator, on the same harness for every model. A number marked with a dagger (†) was reported by the model’s own lab and has not been reproduced independently. Lab-reported numbers are only used where no independent one exists, and never replace one.

Where no trustworthy number exists for a model on a benchmark, the cell is empty. A missing score is never shown as zero, and models without a score are listed separately rather than ranked last.

One row per model

Most current models can think for longer when asked to, and evaluators test each setting separately. The catalogue shows one row per model, using its best-scoring configuration for each benchmark; the setting is noted beside the score on the model’s page.

Because that best score is usually the slowest and most expensive way to run the model, each model page also has a table of every effort setting with its score, cost per task and time to first answer.

Price and cost

List price is the lab’s own API price in US dollars per million tokens, input and output, at the base tier. Blended price weights three parts input to one part output, the common convention for a single comparable figure.

Cost per task is what Artificial Analysis actually spent, on average, for the model to complete one task of its Intelligence Index at the stated effort, reasoning tokens included. Two models with the same list price can differ several-fold here, which is why the value chart uses it by default.

How the “Best for…” picks are chosen

Each pick is the top model on one metric, computed from the same data as the tables. Nothing is hand-picked.

  • Most capable overall: highest Artificial Analysis Intelligence Index.
  • Coding agents: highest Terminal-Bench 4.0 score.
  • Professional work: highest GDPval-AA rating.
  • Novel reasoning: highest verified ARC-AGI-2 score.
  • People's choice: highest Arena text rating.
  • Value near the frontier: highest Intelligence Index points per dollar of cost per task, among models scoring within 15% of the best Intelligence Index.
  • Fastest capable model: highest measured output speed, among models scoring at least 70% of the best Intelligence Index.
  • Best open weights: highest Intelligence Index among models with openly released weights.

Reading the charts

Bars always start at zero and share one axis within a chart, so their lengths can be compared directly. Ratings that have no meaningful zero, such as Arena scores, are drawn as dots on a scale instead: a bar would turn a 30-point gap into what looks like a landslide.

Colour identifies a model only on the comparison page, where each of up to four models keeps its colour in every chart. Everywhere else a single colour is used and models are named in text; with 12 labs, colour-coding by lab would not be distinguishable, least of all for colour-blind readers. Lab logos identify labs.

What benchmarks cannot tell you

  • Benchmarks saturate and leak. Several well-known tests are now near their ceiling or known to be partly in training data; each benchmark page says so where it applies.
  • Agent benchmarks measure a model together with its harness. A score achieved in one coding agent may not transfer to another.
  • Close scores are often statistical ties. Arena ratings a few points apart overlap within their confidence intervals.
  • A model marked New has been out for under 60 days as of the data date; independent results for it are usually still arriving.
  • None of this replaces trying a model on your own task. Use the numbers to build a shortlist, then test.

Which models are listed

The current line-up of each major lab: the models a developer would choose between today, from flagship to fast tier, plus notable open-weight releases. Superseded generations are left out so that the lists stay readable. Artificial Analysis Intelligence Index is the default ranking because it is independent and covers every model here.

A lab is listed once it has a current-generation model with independent results. Amazon (Nova 2 Lite, December 2025) and Microsoft (MAI-Thinking-1, in preview with no published price) are not listed yet for that reason.

Specs and prices come from each lab’s own model and pricing pages. Release dates, context windows and prices for the few models whose official pages could not be read fall back to the Artificial Analysis and Arena listings.

Updating the data

The numbers are not typed by hand. Dated snapshots of every source live in the repository, and a script joins them to the hand-written model list to produce the catalogue. Refreshing the site means replacing the snapshots and running one command; the project README has the details.

Data sources

  • Artificial Analysis (opens in a new tab)

    Intelligence Index, GDPval-AA, cost per task, output speed and time to first answer, measured per reasoning-effort setting.

  • Arena (opens in a new tab)

    Human-preference ratings for text, web development and vision (formerly LMArena).

  • Epoch AI Benchmarking Hub (opens in a new tab)

    Independent runs of FrontierMath and GPQA Diamond, and the Epoch Capabilities Index.

  • ARC Prize (opens in a new tab)

    Verified ARC-AGI-2 and ARC-AGI-3 results.

  • Terminal-Bench (opens in a new tab)

    Terminal-Bench 4.0 agent results.

  • Scale AI Labs (opens in a new tab)

    SWE-Bench Pro V2 and Humanity's Last Exam (Diamond).

  • LiveBench (opens in a new tab)

    Refreshed-question benchmark across seven skill areas.

  • MathArena (opens in a new tab)

    Recent mathematics competitions and olympiads.

  • Andon Labs (opens in a new tab)

    Vending-Bench 2 long-horizon agent results.

  • SimpleBench (opens in a new tab)

    Common-sense reasoning questions with a human baseline.

Benchmarks and their dates

  • Artificial Analysis Intelligence IndexOct 8, 2026
  • Epoch Capabilities IndexSep 29, 2026
  • LiveBenchOct 8, 2026
  • Terminal-Bench 4.0Oct 6, 2026
  • SWE-Bench Pro (V2 Hard)Sep 22, 2026
  • Arena WebDevOct 7, 2026
  • GDPval-AAOct 8, 2026
  • Vending-Bench 2Oct 8, 2026
  • ARC-AGI-2Oct 8, 2026
  • ARC-AGI-3Oct 8, 2026
  • FrontierMath (Tiers 1–3)Sep 29, 2026
  • MathArenaOct 8, 2026
  • SimpleBenchOct 1, 2026
  • Humanity's Last Exam (Diamond)Sep 9, 2026
  • GPQA DiamondSep 29, 2026
  • Arena VisionOct 2, 2026
  • Arena TextOct 2, 2026
Yardstick

A plain reading of how today’s SI models compare. Scores are taken from each benchmark’s own leaderboard wherever one exists; anything a lab reported about its own model is marked.

Data as of Oct 8, 2026.

Explore

  • Models
  • Compare
  • Benchmarks
  • Value
  • Labs
  • Methodology & sources

Sources

  • Artificial Analysis (opens in a new tab)
  • Arena (opens in a new tab)
  • Epoch AI Benchmarking Hub (opens in a new tab)
  • ARC Prize (opens in a new tab)
  • Terminal-Bench (opens in a new tab)
  • Scale AI Labs (opens in a new tab)

Yardstick is an independent reference and is not affiliated with, sponsored by or endorsed by any lab listed. Product names and logos are trademarks of their respective owners and are used only to identify them. Benchmarks are imperfect proxies: check a model on your own task before you commit to it.

  • Models
  • Compare
  • Benchmarks
  • Value
  • Labs
  • Models
  • Compare
  • Benchmarks
  • Value
  • Labs
  • Models
  • Compare
  • Benchmarks
  • Value
  • Labs