Runtime learning always wins over design-time learning because: (1) design time can't cover every case while runtime customizes to the actual encountered world, (2) runtime learning scales with available compute while design time scales with human expertise, and (3) historically, scaling with compute wins in the long run
causalpending
Speaker
Richard SuttonEvidence Quote
“Runtime learning I think always wins over design time... Runtime learning scales with available compute whereas design time learning scales with the available human expertise at design time. It was the only thing available and historically scaling with compute wins in the long run”
Source
Rich Sutton, The OaK Architecture: A Vision of SuperIntelligence from Experience - RLC 2025— AmiiCreated: 8/11/2026, 6:51:29 AM
Your notes
Loading notes...