causal

Intelligence Alone Is Not an Existential Threat

The fear that AGI will end humanity rests on misconceptions: intelligence is just a conversion ratio from information to the ability to act in novel situations—a pathfinding ability—that does not entail goals or values; to be dangerous like SkyNet a system must additionally be given autonomous sensing, autonomous acting, its own value system, and autonomous goal-setting with no human supervision, so danger must be deliberately engineered and the real risk is humans misusing the tool, not the tool competing with humanity.

causalpending

Speaker

François Chollet

Evidence Quote

“intelligence in itself is just a tool. It's just a way to accomplish goals. If you don't look it up to autonomous goal setting, then it is pretty much harmless.”

Source

280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's Mindscape
Created: 6/13/2026, 12:07:39 AM

Your notes

Loading notes...