causal

Memorization Can Substitute for Intelligence on Tests

When showing skill at familiar tasks you can always trade off intelligence for memorization; just as a student who crams thousands of past exams can score high by fetching memorized patterns without understanding the concepts, LLMs—being superhuman memorization machines—produce the appearance of skill and understanding with no actual understanding, which is why the school system's reliance on memorizable tests fails to distinguish the two.

causalpending

Speaker

François Chollet

Evidence Quote

“you can always trade off intelligence for memorization... what if you have an LLM that can actually memorize 10000 exams it can end up showing very strong... The appearance of skill, the appearance of understanding with no actual understanding of concepts.”

Source

280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's Mindscape
Created: 6/13/2026, 12:07:39 AM

Your notes

Loading notes...