definition
ARC Designed to Resist Memorization
ARC functions as an IQ test for machine intelligence that, unlike most LLM benchmarks, is designed to resist memorization because each puzzle is novel and requires only 'core knowledge' (elementary physics, objectness, counting) that any young child possesses, rather than vast crammed knowledge.
definitionpending
Speaker
François CholletEvidence Quote
“ARC is intended as a kind of IQ test for machine intelligence. What makes it different from most LLM benchmarks out there is that it’s designed to be resistant to memorization.”
Source
Francois Chollet — Why the biggest AI models can't solve simple puzzles— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:26:16 AM
Your notes
Loading notes...