Solve an unpublished research-level physics problem to a numeric or symbolic answer checked by an official server.
32.3%
best published result
of 78 models
max
Source: CritPt / Artificial AnalysisOpenAIUnited States· released Jul 2026
Best published result on 2 of the 20 tests it has taken.
OpenAI, United States. One of 26 models from this lab on the Index.

Available in Theo as Theo Explore
Theo orchestrates it for the steps it does best and always shows which engine answered.
Snapshot September 8, 2026
OpenCharts Index
89.8
Ranked #5 of 36 · 10.2% behind the frontier on average · 20 comparable tests · 3 counting categories
Drop any single test and the Index lands between 88.7 and 92.4.
Needs more results (3 of 8 so far)
Averaging 92.5 on the 3 it has; the score opens at 4 of 8.
Distance to today's frontier on the hardest tests. Not a measure of intelligence.
What it's known for
Strongest in reasoning (94.5) and math (90.8). It holds the best published result on CritPt and Mock AIME 2024–2025. It trails the frontier most in coding, 16.0% behind on average. No comparable result yet in long context. Between 10% and 15% behind the best published results, on average.
Strongest category
Reasoning
Hard, novel problems: graduate science, abstract puzzles, expert exams.
94.5
Mean of 5 of the category's 6 comparable tests. Counts toward the Index.
Best single result
Solve an unpublished research-level physics problem to a numeric or symbolic answer checked by an official server.
32.3%
Best published result of 78 models.
Research physics is far past textbook recall. Only a few models produce anything a physicist would accept.
Where it trails
Build a web app from the same prompt as a rival model; real users vote blind on the result.
1,617
47.5 points short of parity with the board leader (1,797) · #10 of 86.
People judging finished apps side by side is the most honest measure of front-end quality.
Not measured yet
No comparable result yet in this category. A blank is a blank, never a zero, and it does not lower the Index.
Covered, but not averaged into the Index:
See it at work
Every test it has taken, by category, with the kind of task it faced, who produced the number and where the result landed against the best published one. The examples are original and illustrative, never items from the datasets themselves.
Reasoning · mean 94.5 across 5 comparable tests · counts toward the Index
Solve an unpublished research-level physics problem to a numeric or symbolic answer checked by an official server.
32.3%
best published result
of 78 models
max
Source: CritPt / Artificial AnalysisSolve the original Abstraction and Reasoning Corpus: small grids, a handful of examples, one hidden rule.
97.5%
99.0% of the best (98.5%)
#4 of 51 · n = 100
xhigh
Close to saturated at the frontier; scores depend on the compute budget a lab chose.
Source: ARC Prize FoundationInfer the hidden rule from a few input and output grid pairs, then apply it to a new grid.
92.5%
97.4% of the best (95.0%)
#2 of 51 · n = 120
max
Scores depend on the compute budget a lab chose; ARC Prize publishes cost per task beside every score and this ranking does not.
Source: ARC Prize FoundationAnswer a PhD-level multiple-choice question in physics, chemistry or biology that a web search will not settle.
93.5%
96.8% of the best (95.8%), above chance
#8 of 78 · n = 198
max
Frontier models cluster in the eighties and nineties; Epoch's standard errors on this test are 2 to 3 points.
Source: Epoch AI (internal runs)Answer everyday trick questions about the physical and social world that most people find easy.
64.8%
79.1% of the best (81.9%)
#15 of 46
Every result is read against the best published one on its test: percent scores as a share of the best above chance, Arena ratings as the expected win rate against the board leader, open-ended values on a log scale. Sitting a harder exam never lowers a model. Every number links to the publisher that produced it.
Head to head
Choose a rival. Every counted test both have taken appears side by side as a share of the best published result on that test, with the category means above. A win is a higher share; a gap under 2 points is a tie, because one item on a 45-problem exam is 2.2 points and publishers' own standard errors are of that order.
GPT-5.6 Sol
#5·Index 89.8A-
0 : 10
wins · 4 ties · 14 shared
GPT-6 Astra
#1·Index 99.0A+
GPT-6 Astra comes out ahead on 10 of the 14 tests both have taken.
Category means
Reasoning
Knowledge
Coding
Math
Agentic
Multimodal
Human preference
Shared tests · biggest gaps first
Bars are distances to the best published result on each test (percent scores above chance, Arena ratings as win rate against the leader, open-ended values on a log scale). Raw values as the publishers report them.
Open GPT-6 AstraScores
The best published run per benchmark, the raw value as the publisher reports it, who produced the number, how close it comes to the best published result on that test, and where the model sits among every model scored on it. Percent scores are read above chance, Arena ratings as a win rate against the board leader, open-ended values on a log scale. A test with too few models to compare against is shown but not counted.
Category means
Mean · tests taken of the category's comparable tests. A faded category either rests on fewer than half of them or is a single-test category (marked “beside”), which is shown next to the Index and never averaged into it.
93.5%
96.8% of the best (95.8%), above chance
91th percentile of 78 · n = 198
max
Source: Epoch AI — AI Benchmarking Hub92.5%
97.4% of the best (95.0%)
98th percentile of 51 · n = 120
max
Source: Epoch AI — AI Benchmarking Hub97.5%
99.0% of the best (98.5%)
90th percentile of 51 · n = 100
xhigh
Source: Epoch AI — AI Benchmarking Hub64.8%
79.1% of the best (81.9%)
67th percentile of 46
32.3%
best published result
of 78 models
max
Source: Epoch AI — AI Benchmarking Hub69.7%
92.2% of the best (75.6%)
93th percentile of 57 · n = 1,000
max
Source: Epoch AI — AI Benchmarking Hub56.9%
91.8% of the best (62.0%)
92th percentile of 73 · n = 338
high
Source: Epoch AI — AI Benchmarking Hub88.8%
95.5% of the best (92.9%)
93th percentile of 69
high
Source: Epoch AI — AI Benchmarking Hub47.5%
88.8% of the best (53.5%)
81th percentile of 27
harness: codex · reasoning effort: max
Source: Epoch AI — AI Benchmarking Hub67.2%
91.6% of the best (73.4%)
75th percentile of 21
max · reasoning level: Max
Source: Epoch AI — AI Benchmarking Hub1,617
26% expected win rate against the board leader (1,797)
89th percentile of 86
xhigh · codex-harness · board 2026-09-05
Source: Arena (LMArena) — Leaderboard Dataset100.0%
best published result
of 78 models
max
Source: Epoch AI — AI Benchmarking Hub89.1%
95.1% of the best (93.7%)
97th percentile of 61 · n = 290
max
Source: Epoch AI — AI Benchmarking Hub82.9%
85.0% of the best (97.6%)
94th percentile of 51 · n = 48
max
Source: Epoch AI — AI Benchmarking Hub83.0%
83.0% of the best (100.0%)
92th percentile of 61
max · reasoning effort: max
Source: Epoch AI — AI Benchmarking Hub27.3%
87.0% of the best (31.4%)
88th percentile of 9 · n = 108
max
Source: Epoch AI — AI Benchmarking Hub39.9%
84.2% of the best (47.4%)
83th percentile of 49
max
Source: Epoch AI — AI Benchmarking Hub$9,619
95.2% of the best ($11,182) on a log scale
96th percentile of 53
1,282
46% expected win rate against the board leader (1,313)
77th percentile of 54
xhigh · board 2026-08-27
Source: Arena (LMArena) — Leaderboard Dataset1,483
47% expected win rate against the board leader (1,507)
86th percentile of 92
xhigh · board 2026-09-02
Source: Arena (LMArena) — Leaderboard DatasetNearby on the leaderboard

28 of the models on this page run inside Theo today. Theo picks the right one for each step and always shows which engine answered.