factual

Endpoints are easier to predict than pathways

It is easier to predict the endpoint of AI development (doom) than the strange winding path that leads there, much like predicting AlphaGo will reach a winning board state without predicting its exact moves; large qualitative capability jumps in GPT models were not predicted in advance even though smooth loss curves underlie them.

factualpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“that loss on text prediction corresponds to qualitative jumps in ability. And I am not familiar with anybody who predicted those in advance of the observation.”

Source

Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:29:05 AM

Your notes

Loading notes...