causal

Gemini Language Learning Is Template Mining

Gemini 1.5's ability to learn a low-resource language (under 200 speakers) in-context from a grammar book and dictionary is not on-the-fly synthesis but the model mining a required template from its vast training data and reusing it, since LLMs have a very poor ability to synthesize or adapt new program templates on the fly.

causalpending

Speaker

François Chollet

Evidence Quote

“We know that LLMs have a very poor ability to synthesize new program templates like this on the fly or even adapt existing ones. They're very much limited to fetching.”

Source

Francois Chollet — Why the biggest AI models can't solve simple puzzles— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:26:16 AM

Your notes

Loading notes...