Runtime learning always wins over design-time learning because: (1) design time can't cover every case while runtime customizes to the actual encountered world, (2) runtime learning scales with available compute while design time scales with human expertise, and (3) historically, scaling with compute wins in the long run

causalpending

Speaker

Richard Sutton

Evidence Quote

“Runtime learning I think always wins over design time... Runtime learning scales with available compute whereas design time learning scales with the available human expertise at design time. It was the only thing available and historically scaling with compute wins in the long run”

Source

Rich Sutton, The OaK Architecture: A Vision of SuperIntelligence from Experience - RLC 2025— Amii
Created: 8/11/2026, 6:51:29 AM

Your notes

Loading notes...