Skip to content
Model Index
  • Overview
  • Models
  • Compare
  • Benchmarks
  • Finder
LabsMethodology

Snapshot · Oct 8, 2026

Methodology & sources

Model Index does not run benchmarks. It gathers results from independent evaluators, lines them up per model, and is explicit about how anything derived is calculated.

  • Sources
  • Which models are included
  • Reading a score
  • Composite scores
  • Price and cost
  • The model finder
  • What this cannot tell you

Sources

Every benchmark figure on the site was published by a third party. Each one is shown with the evaluator's name and links back to the page it came from.

  • Artificial Analysisretrieved Oct 8, 2026

    Intelligence Index v4.3.2 and its component evaluations, measured output speed, latency, list prices and cost per task.

  • Arenaretrieved Oct 7, 2026

    Human-preference ratings from blind votes: Text, Vision and Agent boards (2 Oct) and WebDev (7 Oct).

  • Vals AIretrieved Oct 7, 2026

    Vals Index v2.1 and its finance, coding, legal and tax components, with cost per test.

  • ARC Prizeretrieved Oct 8, 2026

    Verified ARC-AGI-2 and ARC-AGI-3 results on semi-private sets, with cost per task.

  • Lab documentationretrieved Oct 8, 2026

    Release dates, context windows, modalities, licences and list prices from each lab's own announcements, model cards and pricing pages.

Numbers that a lab published about its own model appear only on that model's page, under a separate heading. They use the lab's own harness and settings, so they are never mixed into rankings, composites or the finder.

Which models are included

41 models from 19 labs: the lineup each lab currently sells or promotes, plus its strongest open-weights release. Superseded versions are left out unless they are still the lab's only option in a tier. Image, video and audio generators are out of scope.

A model marked limited access has been announced and evaluated but cannot yet be used by the general public. A model marked preview is usable but the lab may still change it.

Reading a score

One model, many settings. Most current models have a reasoning-effort dial, and the same model can score very differently along it. The headline figure is the model at its strongest measured setting; the setting is printed beside the number, and each model page shows the full ladder with cost and waiting time at every step.

Tests and votes are different things. An independent test has right answers. A human-preference rating records which reply people liked more in a blind comparison — useful, but it rewards style as well as substance.

Small gaps are noise. Artificial Analysis estimates under ±1 point of uncertainty on its index, Vals reports roughly ±1, and Arena ratings for new models can swing by ±10 or more. Where a margin is published it is shown next to the score.

A blank is not a zero. “Not tested” means the evaluator has not published a run. Rankings always say how many models they cover.

Composite scores

The six area scores (0–100) exist so models can be compared on a whole area at once. For each benchmark, a model is placed between the weakest tracked model (0) and the strongest (100). The area score is the weighted average of those positions across the benchmarks below. A model needs the first benchmark listed, or at least half of the set, to receive a score.

Overall
Intelligence Index ×2, Vals Index, Arena Text
Coding
Terminal-Bench 4.0 ×2, Arena WebDev, Vibe Code, Code Migration, SciCode
Agents & knowledge work
GDPval-AA ×2, Arena Agent, Finance Agent, Excel Modeling, Legal Research, Tax Agent
Reasoning & science
HLE, CritPt
Knowledge & reliability
Omniscience ×2, Long-context
Vision
MMMU-Pro ×2, Arena Vision

Saturated or thinly covered benchmarks — GPQA Diamond, ARC-AGI-2 and ARC-AGI-3 — are reported on their own pages but kept out of the composites, so a model is not rewarded or penalised for whether it happened to be tested.

Price and cost

List price is the lab's published rate per million input and output tokens. The single blended price assumes three input tokens for every output token.

Cost per task is what Artificial Analysis actually spent running its Intelligence Index, divided by the number of tasks. Because it counts reasoning tokens, it often tells a different story from list price: a cheap-per-token model that thinks at length can cost more per answer than a pricier, terser one.

The efficient frontier is the set of models for which no other tracked model has both a higher Intelligence Index and a lower cost per task.

The model finder

The finder ranks models by a weighted blend of capability and affordability. Capability mixes the area scores according to the use case; affordability places cost per task on a log scale where the cheapest tracked model scores 100. List price stands in when no measured cost exists, and the card says so.

Build software
85% coding + 15% reasoning
Automate office work
75% agents + 25% reliability
Everyday assistant
60% overall + 40% reliability
Research and hard problems
60% reasoning + 40% reliability
Read images and documents
70% vision + 30% reliability
High-volume pipelines
70% overall + 30% reliability

Priority settings: best quality — 100% capability, 0% affordability; balanced — 65% capability, 35% affordability; lowest cost — 40% capability, 60% affordability. Turning on “speed matters” gives measured output speed 20% of the total. Models with less than half the capability of the best eligible model are dropped before ranking.

What this cannot tell you

  • Your task is not a benchmark. Use the rankings to build a shortlist, then test the two or three finalists on your own work.
  • Harnesses matter. Agentic scores depend on the scaffolding around the model. The same model scores differently on Terminal-Bench 4.0 at Artificial Analysis, at Vals AI and in a lab's own run.
  • Some results include a fallback. Where a provider routes a refused request to another of its models, evaluators score what the product returned. Affected models carry a note.
  • It is a snapshot. Leaderboards move weekly. Everything here reflects Oct 8, 2026; follow the source link before relying on a specific figure.

Model Index is independent and not affiliated with any lab or evaluator. Product names and logos are trademarks of their owners, shown only to identify them. 23 benchmarks are tracked in total.

Model Index

An independent snapshot of frontier SI models and how they perform on third-party benchmarks.

Data as of Oct 8, 2026

Explore

  • All models
  • Compare
  • Benchmarks
  • Model finder
  • Labs
  • Methodology & sources

Sources

Benchmark results come from Artificial Analysis, Arena, Vals AI and ARC Prize. Specifications and prices come from each lab's own documentation.

Not affiliated with any lab or evaluator. Names and logos are trademarks of their respective owners and are used only to identify them. Scores change often — check the linked source before making a decision that depends on one.

  • Overview
  • Models
  • Compare
  • Benchmarks
  • Finder
  • Overview
  • Models
  • Compare
  • Benchmarks
  • Finder
  • Overview
  • Models
  • Compare
  • Benchmarks
  • Finder