GPT-4 currently performs chain-of-thought reasoning with a few hundred tokens of test-time compute (equivalent to about 3 minutes of human thinking at 100 tokens per minute), but there exists a massive 'test time compute overhang' where models could theoretically use millions of tokens for iterative debugging and planning, representing a +4 orders of magnitude improvement if unlocked.
factualpending
Speaker
Leopold AschenbrennerEvidence Quote
“GPT-4 can do a few hundred tokens with chain-of-thought... Suppose GPT-4 could think for millions of tokens. That's +4 OOMs on test time compute on one problem.”
Source
Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history— Dwarkesh PatelCreated: 8/12/2026, 6:39:27 PM
Your notes
Loading notes...