normative

Halt AI training because we lack alignment lifeline

A moratorium on further AI training runs should be enacted now rather than waiting for GPT-5, because algorithms keep improving and getting more efficient per FLOP, so starting a freeze at a higher capability level leaves much less lifeline before reaching dangerous territory, and because earlier systems could become entrenched making a later stop harder both politically and technically.

normativepending

Speaker

Eliezer Yudkowsky

Evidence Quote

“if you start that process off at the GPT-5 level, where I don’t actually know how capable that is exactly, you may have a bunch less lifeline left before you get into dangerous territory.”

Source

Eliezer Yudkowsky — Why AI will kill us, aligning LLMs, nature of intelligence, SciFi, & rationality— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:29:05 AM

Your notes

Loading notes...