causal
Search Required For Genuine Creativity
Current language models only mimic and blend their training data; truly creative problem solving that steps beyond training requires searching through spaces of possibilities to find hidden gems—as AlphaGo's Move 37 came not from human game data but from search identifying an unlikely-but-plausible move and discovering it was excellent—so we won't see systems exceeding their training data until powerful search is added.
causalpending
Evidence Quote
“I don't think we'll see systems that truly step beyond their training data until we have powerful search in the process.”
Source
Shane Legg (DeepMind Founder) — 2028 AGI, superhuman alignment, new architectures— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:31:07 AM
Your notes
Loading notes...