factual

Two honest non-aliens can't settle alignment

For ten years effective altruism has been unable to figure out whether Yudkowsky or Paul Christiano is right about alignment, even though both are honest non-aliens; verifying alignment results from possibly-lying aliens (AIs) would be far harder than adjudicating this human disagreement.

factualpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“we have these two honest non aliens having an argument about alignment and people can’t figure out who’s right. Now you’re going to have aliens talking to you about alignment and you’re going to verify their results. Aliens who are possibly lying.”

Source

Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:29:05 AM

Your notes

Loading notes...