causal
Maximum entropy over the right space predicts doom
Predicting doom is an exercise in choosing the right space over which to be maximally uncertain: just as the correct prior for a lottery is over all ticket numbers (not over win/lose), the correct prior over AI outcomes is over the vast space of computations a superintelligence could maximize, in which human-flourishing outcomes occupy only a narrow sliver, so high confidence of a bad outcome follows from correctly-shaped ignorance rather than a detailed predictive theory.
causalpending
Speaker
Eliezer YudkowskyEvidence Quote
“You’re saying all lottery numbers are equally likely instead of winning and losing are equally likely.”
Source
Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:29:05 AM
Your notes
Loading notes...