causal
LLM Fixes Are Pointwise and Cannot Generalize
Because LLMs are big differentiable parametric curves fit to a data distribution, you cannot input symbolic rules valid for whole categories of problems; you can only supply individual data points the model interpolates between, so fixing errors requires labor-intensive pointwise patches that address one query at a time rather than entire categories of issues.
causalpending
Speaker
François CholletEvidence Quote
“It is virtually impossible to fix a general category of issues at once. And the reason why is because these models, they're basically big curves, they're big differential parametric curves that are fit to a data distribution.”
Source
280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's MindscapeCreated: 6/13/2026, 12:07:39 AM
Your notes
Loading notes...