factual
Endpoints are easier to predict than pathways
It is easier to predict the endpoint of AI development (doom) than the strange winding path that leads there, much like predicting AlphaGo will reach a winning board state without predicting its exact moves; large qualitative capability jumps in GPT models were not predicted in advance even though smooth loss curves underlie them.
factualpending
Speaker
Eliezer YudkowskyEvidence Quote
“that loss on text prediction corresponds to qualitative jumps in ability. And I am not familiar with anybody who predicted those in advance of the observation.”
Source
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:29:05 AM
Your notes
Loading notes...