Eliezer's probability that the orthogonality thesis is false (i.e., that moral realism, moral cognitivism, and moral internalism all obtain such that superintelligent agents converge on objective morality) is 'basically no'—near-zero but not negative infinity, because he can imagine coherent systems that want tiny molecular spirals, which would be misaligned regardless of metaphysical facts about morality.

forecastpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“my probability on that is basically no...I can see how you put together a mind that wants tiny molecular Spirals and wants to want tiny molecular Spirals”

Source

Live: Eliezer Yudkowsky - Is Artificial General Intelligence too Dangerous to Build?— Center for the Future of AI, Mind & Society
Created: 8/10/2026, 3:35:53 PM

Your notes

Loading notes...