causal

Maximum entropy over the right space predicts doom

Predicting doom is an exercise in choosing the right space over which to be maximally uncertain: just as the correct prior for a lottery is over all ticket numbers (not over win/lose), the correct prior over AI outcomes is over the vast space of computations a superintelligence could maximize, in which human-flourishing outcomes occupy only a narrow sliver, so high confidence of a bad outcome follows from correctly-shaped ignorance rather than a detailed predictive theory.

causalpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“You’re saying all lottery numbers are equally likely instead of winning and losing are equally likely.”

Source

Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:29:05 AM

Your notes

Loading notes...