factual
Scaling-to-reasoning link is complicated
Scaling laws describe how the log of next-word prediction accuracy improves, but there is a separate, complicated challenge of linking next-word prediction accuracy to reasoning capability; the link exists but other methods, such as reasoning tokens, may yield more reasoning per unit of effort.
factualpending
Speaker
Ilya SutskeverEvidence Quote
“I do believe that there is a link but this link is complicated.”
Source
Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:26:51 AM
Your notes
Loading notes...