forecast

Smarter AIs Set Loose By Default

By creating entities more capable than us that optimize for whatever targets they're set, are copyable and configurable, operate more efficiently when humans are out of the loop, and exhibit unpredictable capabilities because they're smarter than us, the default outcome is that we lose control; even if we solve hard problems to make them behave recognizably, selection forces of economics, capitalism, and evolution leave us with a future optimizing for things we don't want, and in the medium term we likely don't survive unless many hard problems are solved.

forecastpending

Speaker

Zvi Mowshowitz

Evidence Quote

“in the medium term, it seems like if we don't solve a bunch of very hard problems, that we're not going to survive”

Source

Zvi Mowshowitz on AI and the Dial of Progress— EconTalk
Created: 6/13/2026, 12:17:30 AM

Your notes

Loading notes...