factual

Value lock-in is historically unprecedented and implausible

The idea that one actor will use a software-singularity AI to 'lock in' a stable utility function for millions of years looks unlike anything in history; even digital information suffers rapid link rot and digitization has been associated with faster, not slower, cultural change — so the argument that we can preserve utility functions forever is weak.

factualpending

Speaker

Ege Erdil

Evidence Quote

“they think this moment is a pivotal moment in history... they're just going to lock in some values. And then those values are going to be stable for millions of years”

Source

AGI is still 30 years away — Ege Erdil & Tamay Besiroglu— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:24:17 AM

Your notes

Loading notes...