causal

Curve Fitting Has Low Intelligence Due to Data Inefficiency

Curve fitting via gradient descent is a form of learning with non-zero but very low intelligence because it converts data into solutions at an extremely poor, data-inefficient conversion ratio; a truly intelligent system would let you fix an error by explaining why an answer was wrong and have it automatically patch the entire underlying category of issues, rather than requiring pointwise fixes.

causalpending

Speaker

François Chollet

Evidence Quote

“It's extremely data inefficient. But it has very, very low intelligence. For this reason a system that is very intelligent would not be limited to this sort of like pointwise mappings like LLMs are.”

Source

280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's Mindscape
Created: 6/13/2026, 12:07:39 AM

Your notes

Loading notes...