causal
Memorization Can Substitute for Intelligence on Tests
When showing skill at familiar tasks you can always trade off intelligence for memorization; just as a student who crams thousands of past exams can score high by fetching memorized patterns without understanding the concepts, LLMs—being superhuman memorization machines—produce the appearance of skill and understanding with no actual understanding, which is why the school system's reliance on memorizable tests fails to distinguish the two.
causalpending
Speaker
François CholletEvidence Quote
“you can always trade off intelligence for memorization... what if you have an LLM that can actually memorize 10000 exams it can end up showing very strong... The appearance of skill, the appearance of understanding with no actual understanding of concepts.”
Source
280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's MindscapeCreated: 6/13/2026, 12:07:39 AM
Your notes
Loading notes...