News
DN
NoodleNews
ANALYSIS
8 JUL 2026
Artificial intelligence · the pace of progress

Frontier AI’s exam scores have stalled near the ceiling. Its real-world reach is still doubling.

The benchmarks the industry leaned on have saturated, which makes progress look like a plateau. On task length — the least saturated measure available — the reach of frontier models has gone on doubling roughly every four to seven months. The pre-training recipe that built the 2023 models has hit real limits; a different engine is now doing most of the work.

94%
Top GPQA Diamond science score today, up from 39% at GPT-4 in 202336
~5hrs
Longest task the best-measured 2025 model does at 50% reliability (Claude Opus 4.5)1
~4mo
Doubling time of that reach on 2023-onward data — versus ~7 months over 2019–251
What the data shows

The exam scores stalled — because the exams ran out

The most-quoted way to track AI progress is the score on a hard benchmark, and by that measure the top models have bunched up. On GPQA Diamond, a set of graduate-level science questions where subject-matter PhDs score about 65% and random guessing yields 25%,3 GPT-4 managed 39% in 2023.3 By early 2026 the leading models from OpenAI, Anthropic and Google were all clustered between roughly 91% and 94% — on a 198-item test whose top scores now differ by only a handful of questions.8

Exhibit 01
Three labs, one ceiling: GPQA Diamond scores converge
Source: GPQA benchmark paper (Rein et al., 2023) for the GPT-4 baseline, expert and chance levels;3 company-reported figures for GPT-4o, o1, o3, GPT-5 and GPT-5.4, for Claude 3 Opus, 3.5 and 3.7 Sonnet and Opus 4.6, and for Gemini 1.5 Pro and the 2.5 and 3-series,567 with Gemini 2.5 Pro independently confirmed at 84% by Epoch AI.8 The shaded strip marks the arrival of reasoning models (o1, Sep 2024). Note: scores vary by test harness — extended-thinking, tool-use and voting settings differ, and GPT-5 in particular ranges ~83–85% by harness — so read the lines as trajectories, not a precise ranking. Zero-based axis.

Two things are happening at once. The steep early climb is real; the near-vertical jump on the OpenAI line in late 2024 is the arrival of “reasoning” models — o1, which is trained to work through a problem step by step before answering.5 But the flattening at the top is largely an artefact of the ruler, not the runner: once models answer almost every valid question, there is no headroom left to measure, and Epoch AI notes that GPQA and several older tests are now effectively saturated as tools for separating frontier systems.8

Key finding. A flat line at the top of a saturated benchmark is evidence that the test has run out of difficulty — not, on its own, evidence that the models have stopped improving.
The ruler that hasn’t broken

Measured in task length, capability is still doubling

To see past the ceiling you need a measure with room to grow. The research group METR uses one: the task-completion time horizon — the length of job, measured by how long a human expert takes, that a model can finish at a given success rate.1 It converts an abstract score into something concrete (“this system reliably does tasks that take people about X hours”) and, crucially, it does not saturate.

Across models from 2019 to 2025, METR found the 50% time horizon doubling about every seven months, an exponential fit with no sign of a plateau.2 Its January 2026 re-estimate put the long-run doubling at 196 days — but the trend measured only on 2023-onward models is faster, around 131 days (~4 months), and the 2024-onward slice faster still.1 A four-month doubling is roughly a sevenfold increase in reach per year; the seven-month rate is about 3.6-fold. Either way the direction is up, and the recent slope is steeper, not shallower.

Exhibit 02
The reach of frontier models keeps lengthening (log scale)
Source: METR time-horizon data (Time Horizon 1.1 re-estimate, all 2023-onward points on one method).1 Measured 50% horizons: GPT-4 3.5 min; Claude 3.7 Sonnet 60 min; o3 121 min; Claude Opus 4 101 min; GPT-5 214 min; Claude Opus 4.5 320 min (~5.3 h). The dashed line and shaded wedge are a projection, not data: the dashed line extends METR’s long-run 7-month doubling from the last measured point; the band widens up to its faster ~4-month (2023-onward) rate. Confidence intervals on individual points are wide (e.g. Opus 4.5: 170–729 min).

This is the honest answer to whether the current model set is slowing: on the best unsaturated measure available, it is not — through mid-2026 the pace has held or quickened. But the instrument is straining. METR’s longest calibrated tasks run to about eight hours, so estimates above that are extrapolations, the confidence bands are very wide, and the group flags that measurements beyond roughly 16 hours are unreliable with its current task suite.1 The measure also leans heavily on software and research-engineering tasks, which the labs optimise for hardest.

Why it can still feel slower

One recipe really did hit its limits

The plateau intuition is not baseless. The specific thing that drove the 2020–2023 leaps — training ever-larger models on ever-more web text (“pre-training scaling”) — has run into diminishing returns. At NeurIPS in December 2024 Ilya Sutskever, OpenAI’s former chief scientist, argued that “pre-training as we know it will end” because the field has reached “peak data”: compute keeps growing but the single dataset big enough to train on, the public internet, does not.10 OpenAI researchers have said a shortage of fresh data, more than compute, constrained their GPT-4.5-class training run.4 As the analyst Nathan Lambert puts it, both stories can be true at once: scaling still works at a technical level while the rate of visible improvement for everyday users slows.11

A new basis, already arriving

From bigger models to longer thinking

The reason the capability curve kept climbing while pre-training stalled is that the industry changed its engine. Chain-of-thought prompting (2022) and then reasoning models such as o1 (September 2024) opened a second axis of scaling: spending more computation at the moment of answering — “test-time” or “inference-time” compute — rather than only at training.9 That shift, paired with reinforcement learning on verifiable tasks, is what the GPQA jump and the lengthening METR horizons largely reflect. In other words, part of the follow-up question — whether a new basis will be needed — has already been answered on the ground: a new basis — in training process, and increasingly in data source — is being adopted now.

Exhibit 03
The growth engine has already been swapped once
Source & framing: Noodle News, from dated milestones — the transformer (2017) and the pre-training era it enabled;9 the reasoning / test-time-compute turn from o1 (Sep 2024);9 and Epoch AI’s projected public-text exhaustion window, 2026–2032 (median 2028).4 Bars mark when each approach was, or is projected to be, a leading source of gains; hatched blocks are projected or emerging, not recorded. Era boundaries are an editorial simplification.

On the data side, the constraint is concrete. Epoch AI estimates the usable stock of public human text at about 300 trillion tokens and projects that training sets will grow to meet it somewhere between 2026 and 2032, with a median of 2028.4 The proposed ways round the wall are the other half of the “new basis” question: synthetic (model-generated) data, especially for reasoning; other modalities such as image, audio and video; and squeezing more from the same data.4 Whether any of these fully substitutes for fresh human text is unproven.

What we don’t know

Whether the recent, faster doubling rate is a durable regime or a temporary burst from reinforcement-learning gains that will revert toward the seven-month trend. Whether reasoning and test-time compute face their own diminishing returns as pre-training did. And how much of the measured acceleration is real capability versus an artefact of a measuring instrument that runs out of long-enough tasks. The projections here — the METR wedge and the data-wall window — are scenarios on current trends, not forecasts we endorse.

Where it’s contested

Will the current pace hold?

Credible researchers genuinely disagree. This is largely an empirical dispute — the kind evidence can eventually settle — about how long the present paradigm keeps delivering.

The case for continuation

Test-time compute and reinforcement learning have opened a second scaling axis with headroom left; the 2024–25 gains came largely without proportionally more training compute, and the METR horizon has, if anything, accelerated. Anthropic’s Dario Amodei has said scaling is “probably going to continue”; OpenAI’s Sam Altman maintains “there is no wall.”11

Empirical dispute
The case for a slowdown

Pre-training’s data source is finite and near-exhausted; synthetic data has not clearly closed the gap; and inference-time scaling may hit its own diminishing returns, since buying performance with ever-more compute per answer gets expensive fast. Sutskever’s “peak data” and Epoch’s data-wall work point the same way.104

Empirical dispute

Bottom line. The evidence to mid-2026 supports a narrow claim: the current model set has not slowed on the best available capability measure, and a genuine change of basis — reasoning and test-time compute — is what kept it moving. The broader claim, that this pace continues for years, is not established. The strongest objection to “no slowdown” is that the one metric still showing acceleration is also the one whose measuring instrument is closest to breaking.

By the numbers
~300T
Estimated usable tokens of public human text (Epoch AI)4
2028 proj.
Median year that stock is projected to be fully used4
+55 pts
GPQA Diamond climb, GPT-4 (2023) to today’s best36
161
Highest Epoch Capabilities Index score to date (mid-2026)8
Caveat. The headline “no slowdown” rests most heavily on METR’s time horizon, whose longest calibrated tasks are about eight hours and which is weighted toward software work. If the top of that scale is mismeasured, or if software progress outruns other domains, the acceleration could be narrower than it looks.1
Reference · the measured record

The time-horizon points behind Exhibit 02

METR’s 50% time horizons (Time Horizon 1.1 method), the measured series in Exhibit 02. Values are minutes of human-expert task time; the reader can check the log-scale plot against them.

ModelReleased50% horizon (min)\u2248 human time
GPT-4Mar 20233.5~4 min
Claude 3.7 SonnetFeb 2025601 h
o3Apr 2025121~2 h
Claude Opus 4May 2025101~1.7 h
GPT-5Aug 2025214~3.6 h
Claude Opus 4.5Dec 2025320~5.3 h
Go deeper

Read more

Threads held back to keep this to length:

Method. This piece asks two things: is the current frontier-model paradigm slowing, and will a new basis be needed. To avoid the ceiling effect that makes saturated exams look like a plateau, the pace question is judged on METR’s task-completion time horizon, the least saturated public measure of capability, alongside GPQA Diamond (shown precisely because it has saturated). All plotted figures are transcribed from the cited primary or independent sources and re-checked in code; GPQA values are company-reported except where independently confirmed, and differ by test harness, so Exhibit 01 is read as a set of trajectories. The METR projection (Exhibit 02) extends the group’s own published doubling times — 196 days (long-run) and ~131 days (2023-onward) — from the last measured point; it is rendered dashed/shaded and excluded from every hero figure. The “data wall” window (2026–2032, median 2028) and the era boundaries in Exhibit 03 are projections and editorial framing respectively, labelled as such.
Sources. Highest tier first; each inline citation resolves here.
  1. T1METR — Task-Completion Time Horizons of Frontier AI Models (live data) and Time Horizon 1.1 update, metr.org. Retrieved 8 Jul 2026.
  2. T1Kwa, West et al. (METR) — Measuring AI Ability to Complete Long Software Tasks, arXiv:2503.14499, 2025.
  3. T1Rein et al. — GPQA: A Graduate-Level Google-Proof Q&A Benchmark, arXiv:2311.12022, 2023 (GPT-4 39%; PhD-expert ~65%; chance 25%).
  4. T1Villalobos et al. (Epoch AI) — Will we run out of data? Limits of LLM scaling based on human-generated data, arXiv:2211.04325 / epoch.ai. Retrieved 8 Jul 2026.
  5. T1OpenAI — model reports for o1 (“Learning to reason with LLMs”, 2024), o3 and GPT-5.4. Company-reported (interested party).
  6. T1Google DeepMind — Gemini 2.5 Pro and Gemini 3.1 Pro model cards. Company-reported (interested party).
  7. T1Anthropic — Claude 3, Claude 3.7 Sonnet and Claude Opus 4.6 model cards. Company-reported (interested party).
  8. T2Epoch AI — Benchmarking Hub and Capabilities Index (independent evaluations; GPQA saturation; Gemini 2.5 Pro 84%; ECI to 161), epoch.ai. Retrieved 8 Jul 2026.
  9. T2Test-time-compute / reasoning literature — ARC Prize technical reports and test-time-scaling papers (arXiv), on the pre-training vs inference-time paradigms.
  10. T3I. Sutskever, NeurIPS 2024 remarks (“pre-training as we know it will end”, “peak data”), as reported by The Verge and Reuters. Cited for attribution.
  11. T3Scaling-debate positions — D. Amodei and S. Altman (public remarks) and N. Lambert (analysis), via press. Cited for attribution.
Corrections. v1.1 (20 Oct 2026): on narrow phone screens some chart labels ran off the edge of the chart; Exhibit 3’s “Pre-training scale-up” and “Public-text ‘data wall’” are shortened to “Pre-training scale” and “Text ‘data wall’”. No figures changed.
Figures to 8 Jul 2026. Noodle News · v1.1 · ai-pace-of-progress.