core knowledge
Basic foundational knowledge about the world—elementary physics, objectness, counting, geometry, topology, symmetries—that any young child possesses and that ARC puzzles require.
As defined in Francois Chollet — Why the biggest AI models can't solve simple puzzles
Where it comes up · 2
- Francois Chollet — Why the biggest AI models can't solve simple puzzles4 claims
- Francois Chollet | Why abstraction is the key to intelligence, and what we’re still missing2 claims
Most important claims · 6 of 6Search all claims for “core knowledge” →
- ARC functions as an IQ test for machine intelligence that, unlike most LLM benchmarks, is designed to resist memorization because each puzzle is novel and requires only 'core knowledge' (elementary physics, objectness, counting) that any young child possesses, rather than vast crammed knowledge.Francois Chollet — Why the biggest AI models can't solve simple puzzles
- Core knowledge is mostly acquired through experience very early—within the first 3-4 years of life rather than in school—such that by age four a person has all the core knowledge they will need as an adult; humans are not blank slates and are born with a small amount of innate world knowledge, but most core knowledge is learned.Francois Chollet — Why the biggest AI models can't solve simple puzzles
- Core knowledge is a set of innate cognitive human priors (identified by Elizabeth Spelke) that are possessed by humans, guide our ability to learn throughout life, form the atomic building blocks of thinking, are innate or acquired very early (first 1-2 years), universal across humans, and ancient (found in non-human primates and animals).Francois Chollet | Why abstraction is the key to intelligence, and what we’re still missing
- The illegitimate way to win ARC is brute-forcing the space of possible tasks: generating hundreds of millions of programmatic ARC-task variations so that there is enough overlap with the test set to score highly via memorized fetching—this would reveal a benchmark flaw rather than genuine intelligence, whereas adding a code interpreter or fine-tuning on core knowledge is legitimate.Francois Chollet — Why the biggest AI models can't solve simple puzzles
- A genuine ARC solution trained only on core knowledge, while not necessarily AGI itself, would be a huge milestone because it represents the ability to synthesize a generalizing problem-solving program from just two or three examples—an entirely new paradigm where you program by showing the computer the desired output rather than typing up the program yourself.Francois Chollet — Why the biggest AI models can't solve simple puzzles
- The Abstraction and Reasoning Corpus (ARC) is designed as an intelligence test for both humans and machines, grounded purely in core knowledge (objectness, elementary geometry and topology, numbers, agentness) without requiring prior knowledge like language, with every task being novel and sharing only abstract similarities with other tasks, controlling for experience through few-shot learning from 2-3 examples.Francois Chollet | Why abstraction is the key to intelligence, and what we’re still missing