causal

LLM Fixes Are Pointwise and Cannot Generalize

Because LLMs are big differentiable parametric curves fit to a data distribution, you cannot input symbolic rules valid for whole categories of problems; you can only supply individual data points the model interpolates between, so fixing errors requires labor-intensive pointwise patches that address one query at a time rather than entire categories of issues.

causalpending

Speaker

François Chollet

Evidence Quote

“It is virtually impossible to fix a general category of issues at once. And the reason why is because these models, they're basically big curves, they're big differential parametric curves that are fit to a data distribution.”

Source

280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's Mindscape
Created: 6/13/2026, 12:07:39 AM

Your notes

Loading notes...