forecast

Scaling Hits Walls Near GPT-4 Limits

The era of getting order-of-magnitude capability jumps simply by adding a zero to the budget and assembling ten times more compute is ending, because at GPT-4 we are approaching the limits of available capacity; future gains will require algorithmic creativity and hardware improvement rather than brute-force scaling, so we may not see jumps as fast as 2-to-3-to-4 for several years.

forecastpending

Speaker

Zvi Mowshowitz

Evidence Quote

“in order to get that next order of magnitude of jump in effective compute, you need to be more creative than that, or you have to wait for our technologies to improve some more”

Source

Zvi Mowshowitz on AI and the Dial of Progress— EconTalk
Created: 6/13/2026, 12:17:30 AM

Your notes

Loading notes...