causal

Parametric Curves Only Do Local Generalization

Deep learning is intrinsically limited to local generalization because the substrate of the model is a big parametric curve; to achieve broad or extreme generalization you must move to a different model type—discrete program search/program synthesis—where the model is a discrete graph of operators learned via combinatorial search.

causalpending

Speaker

François Chollet

Evidence Quote

“All you can do with this is local generalization... The reason why you have this limitation is because your model is a curve.”

Source

Francois Chollet — Why the biggest AI models can't solve simple puzzles— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:26:16 AM

Your notes

Loading notes...