Mollick’s SatBench: 63 per cent of benchmarks favoured by AI labs are solved
According to SatBench, compiled by Ethan Mollick, 63 per cent of the 173 benchmarks cited by AI labs since 2023 are saturated, and the pace is accelerating. Counting only independent measurements, the share is 24 per cent.
Ethan Mollick published SatBench on X on 14 November, describing it as a quick compilation. It measures how soon major AI benchmarks become saturated, or effectively beaten. ‘AI is getting better faster than our measurements are’, Mollick wrote.
What 63 per cent means
According to the charts in the post, SatBench includes benchmarks cited in at least ten model announcements from AI labs. A benchmark counts as solved once the best AI score reaches 85 per cent. By November, 109 of the 173 benchmarks had passed that threshold. The data come from Benchmark Almanac, which includes Epoch AI’s Benchmarking Hub.
The best score can come from any source, including a lab’s own announcement. A footnote to the chart puts the solved share at 24 per cent when only independent runs are counted. The 39-percentage-point gap comes from benchmarks that have crossed the threshold only in non-independent measurements, such as labs’ own announcements.
The chart shows the solved share holding at about 30 per cent for two years, because new benchmarks arrived as quickly as old ones fell. The 2023 version of SatBench had 44 benchmarks. In September 2026, the chart shows, that version passed the saturation threshold at which 85 per cent of benchmarks are solved. Now 86 per cent of them are solved.
New benchmarks fall faster than before
A second chart groups benchmarks by release year instead. Mollick said saturation is speeding up year on year. Of benchmarks released in 2023, 17 per cent were solved within a year, compared with 30 per cent of 2024 benchmarks and 43 per cent of 2025 benchmarks, the chart shows.
Within six months, 32 per cent of 2026 benchmarks were solved, compared with 0, 18 and 21 per cent in earlier years. Benchmarks already past the threshold at release count as solved immediately.
The 2026 benchmarks have not yet been tracked for a full year. They also enter the count only after their tenth announcement citation, so the chart says the calculation includes too few of this year’s benchmarks. Benchmarks from 2025 took a median of 14 months to be solved, and those from 2023 and 2024 took 20 months.
An OpenAI model has been the first to cross the 85 per cent threshold on 20 benchmarks, more often than any other lab’s model. In 2026 Anthropic leads with 11. This comparison covers benchmarks for which several labs report results. Unsolved benchmarks include Humanity’s Last Exam, where the best score is 74 per cent, as well as MMMU-Pro, SciCode and IFBench.
The calculation is not a forecast
The chart shows 64 benchmarks still unsolved. In the modelling, each has a 5 per cent chance of falling in any given month, matching the pace of the past 12 months. If no new benchmarks arrived, 85 per cent of the current ones would be solved around 2028. The last would fall around 2034, with an 80 per cent range of 2031–2037.
In a second calculation, an average of 4.7 new benchmarks arrive each month and the solving rate speeds up by one percentage point a year. In that case, 85 per cent of SatBench benchmarks would be solved around 2030. Mollick notes in the chart that the calculation is not a forecast.
Read more: Models