GPT-4 currently performs chain-of-thought reasoning with a few hundred tokens of test-time compute (equivalent to about 3 minutes of human thinking at 100 tokens per minute), but there exists a massive 'test time compute overhang' where models could theoretically use millions of tokens for iterative debugging and planning, representing a +4 orders of magnitude improvement if unlocked.

factualpending

Speaker

Leopold Aschenbrenner

Evidence Quote

“GPT-4 can do a few hundred tokens with chain-of-thought... Suppose GPT-4 could think for millions of tokens. That's +4 OOMs on test time compute on one problem.”

Source

Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history— Dwarkesh Patel
Created: 8/12/2026, 6:39:27 PM

Your notes

Loading notes...