definition
Two Definitions of Reasoning: Template vs Synthesis
Reasoning has two definitions: (1) identifying a memorized program template, plugging in new values, and running it—which LLMs do—and (2) when no program exists in memory, synthesizing a new program on the fly from bits and pieces of existing programs, which is dramatically harder and what true reasoning requires.
definitionpending
Speaker
François CholletEvidence Quote
“There are two definitions you can use. One is, I have available a set of program templates... Here’s another definition of reasoning. When you're faced with a puzzle and you don't already have a program in memory to solve it, it’s the ability to synthesize on the fly a new program”
Source
Francois Chollet — Why the biggest AI models can't solve simple puzzles— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:26:16 AM
Your notes
Loading notes...