causal
Parametric Curves Only Do Local Generalization
Deep learning is intrinsically limited to local generalization because the substrate of the model is a big parametric curve; to achieve broad or extreme generalization you must move to a different model type—discrete program search/program synthesis—where the model is a discrete graph of operators learned via combinatorial search.
causalpending
Speaker
François CholletEvidence Quote
“All you can do with this is local generalization... The reason why you have this limitation is because your model is a curve.”
Source
Francois Chollet — Why the biggest AI models can't solve simple puzzles— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:26:16 AM
Your notes
Loading notes...