forecast

Humans Will Bolt Goals Onto AI

Whether or not AI systems have inherent goals, humans love achieving goals and find goal-directed AI useful, so we are already wrapping GPT-4 in roughly 100 lines of scaffolding (Baby GPT, Auto GPT) to make it act as a goal-motivated agent that creates sub-goals and plans, and from there it's a small leap to 'I need more money'—so we can now rule out, by experiment, Andreessen's theory that future systems won't have goals unless we act to stop it.

forecastpending

Speaker

Zvi Mowshowitz

Evidence Quote

“it's a very small leap from there to, 'I'm going to need more money.' Right? Or something like that. And from there, the sky's the limit.”

Source

Zvi Mowshowitz on AI and the Dial of Progress— EconTalk
Created: 6/13/2026, 12:17:30 AM

Your notes

Loading notes...