factual

Scaling-to-reasoning link is complicated

Scaling laws describe how the log of next-word prediction accuracy improves, but there is a separate, complicated challenge of linking next-word prediction accuracy to reasoning capability; the link exists but other methods, such as reasoning tokens, may yield more reasoning per unit of effort.

factualpending

Speaker

Ilya Sutskever

Evidence Quote

“I do believe that there is a link but this link is complicated.”

Source

Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:26:51 AM

Your notes

Loading notes...