causal

Goals Logically Entail Self-Preservation

Andreessen's claim that AI couldn't possibly wipe us out is logically incoherent: we will give AIs explicit goals, and accomplishing any goal logically requires the AI to remain around and to acquire the affordances, capabilities, and power to achieve it, so resource-seeking and survival behaviors will inevitably arise unless deliberately stopped—the reasonable position is that we might not be wiped out, not that we couldn't be.

causalpending

Speaker

Zvi Mowshowitz

Evidence Quote

“We're talking about Marc saying we couldn't possibly. Right? It's a logical incoherence.”

Source

Zvi Mowshowitz on AI and the Dial of Progress— EconTalk
Created: 6/13/2026, 12:17:30 AM

Your notes

Loading notes...