causal
Gemini Language Learning Is Template Mining
Gemini 1.5's ability to learn a low-resource language (under 200 speakers) in-context from a grammar book and dictionary is not on-the-fly synthesis but the model mining a required template from its vast training data and reusing it, since LLMs have a very poor ability to synthesize or adapt new program templates on the fly.
causalpending
Speaker
François CholletEvidence Quote
“We know that LLMs have a very poor ability to synthesize new program templates like this on the fly or even adapt existing ones. They're very much limited to fetching.”
Source
Francois Chollet — Why the biggest AI models can't solve simple puzzles— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:26:16 AM
Your notes
Loading notes...