Eliezer's probability that the orthogonality thesis is false (i.e., that moral realism, moral cognitivism, and moral internalism all obtain such that superintelligent agents converge on objective morality) is 'basically no'—near-zero but not negative infinity, because he can imagine coherent systems that want tiny molecular spirals, which would be misaligned regardless of metaphysical facts about morality.
forecastpending
Speaker
Eliezer YudkowskyEvidence Quote
“my probability on that is basically no...I can see how you put together a mind that wants tiny molecular Spirals and wants to want tiny molecular Spirals”
Source
Live: Eliezer Yudkowsky - Is Artificial General Intelligence too Dangerous to Build?— Center for the Future of AI, Mind & SocietyCreated: 8/10/2026, 3:35:53 PM
Your notes
Loading notes...