factual

Model learned esoteric language in-context

In an eval, a model learned an actual human language (esoteric enough not to be in training data) in-context better than a human expert could over months, demonstrating superhuman in-context ingestion of information even though the base model knew nothing of the language beforehand.

factualpending

Speaker

Sholto Douglas

Evidence Quote

“one of the evals that we did in the paper had it learn a language in context better than a human expert could, over the course of a couple of months.”

Source

Sholto Douglas & Trenton Bricken — How LLMs actually think— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:31:11 AM

Your notes

Loading notes...