definition
Models learning by themselves analogous to human education
Learning has two phases: pre-training is like passive lecturing where words fly by, while real learning happens by reading, thinking, having an internal monologue, attempting practice problems, and failing until it clicks—humans transition from being pre-trained (grade school) to teaching themselves (by college), and models are just now entering that self-learning regime via self-play, synthetic data, and RL.
definitionpending
Speaker
Leopold AschenbrennerEvidence Quote
“When you learn by yourself, say you're reading a dense math textbook, you're not just skimming through it once... You read a page, think about it, have some internal monologue going on, and have a conversation with a study buddy. You try a practice problem and fail a bunch of times. At some point it clicks.”
Source
Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:30:02 AM
Your notes
Loading notes...