GPT-5.4
Mar 2026 · Proprietary · Superseded · supported evidence
High MMLU, mid coding. Useful as a history point. Not a 2026-Q3 default.
Intelligence
53.1
AA Index
API price
$2.50 / $15
Input / output per 1M
Context
1.05M
125 tok/s
Capability
Intelligence Index53.1
Coding index59
Agentic index48
Arena Elo (offset)166
Use it when
- ▸Knowledge-only evals
Skip if
- –New coding or agent workloads
Benchmarks
GPQA Diamond Graduate-level science questions designed so Google search is not enough. Still one of the cleanest knowledge/reasoning splits. | 92.8% |
|---|---|
Humanity’s Last Exam Expert-written questions across fields. Harder than MMLU; the current differentiator for “does this model actually know things.” | — |
MMLU-Pro Harder, less-saturated successor to MMLU. Classic MMLU is above 90% for every flagship and no longer ranks the field. | 94% |
SWE-bench Verified 500 human-validated GitHub issues. Score swings 5–15 points by harness — treat vendor numbers as an upper bound. | — |
SWE-bench Pro Harder, contamination-resistant coding eval. Currently the best public split between “can code” and “can maintain a repo.” | — |
Terminal-Bench 2.1 End-to-end tasks in a real terminal. Better proxy for coding agents than HumanEval, which is fully saturated. | — |
ARC-AGI-2 Abstract visual puzzles. Rewards generalization over memorization. GPT-5.6 Sol currently leads the published set. | — |
AIME 2025 American Invitational Mathematics Examination. Contest math; reasoning-mode models dominate. | — |
MMMU College-level multimodal understanding across diagrams, charts, and exam figures. | — |
Modalities
text · vision · tools
Reasoning mode
reasoning
Hybrid and reasoning models spend tokens thinking. That raises GPQA and agents, and also raises latency and bill.