forecast
Smarter AIs Set Loose By Default
By creating entities more capable than us that optimize for whatever targets they're set, are copyable and configurable, operate more efficiently when humans are out of the loop, and exhibit unpredictable capabilities because they're smarter than us, the default outcome is that we lose control; even if we solve hard problems to make them behave recognizably, selection forces of economics, capitalism, and evolution leave us with a future optimizing for things we don't want, and in the medium term we likely don't survive unless many hard problems are solved.
forecastpending
Speaker
Zvi MowshowitzEvidence Quote
“in the medium term, it seems like if we don't solve a bunch of very hard problems, that we're not going to survive”
Created: 6/13/2026, 12:17:30 AM
Your notes
Loading notes...