causal
Curve Fitting Has Low Intelligence Due to Data Inefficiency
Curve fitting via gradient descent is a form of learning with non-zero but very low intelligence because it converts data into solutions at an extremely poor, data-inefficient conversion ratio; a truly intelligent system would let you fix an error by explaining why an answer was wrong and have it automatically patch the entire underlying category of issues, rather than requiring pointwise fixes.
causalpending
Speaker
François CholletEvidence Quote
“It's extremely data inefficient. But it has very, very low intelligence. For this reason a system that is very intelligent would not be limited to this sort of like pointwise mappings like LLMs are.”
Source
280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's MindscapeCreated: 6/13/2026, 12:07:39 AM
Your notes
Loading notes...