definition

Models learning by themselves analogous to human education

Learning has two phases: pre-training is like passive lecturing where words fly by, while real learning happens by reading, thinking, having an internal monologue, attempting practice problems, and failing until it clicks—humans transition from being pre-trained (grade school) to teaching themselves (by college), and models are just now entering that self-learning regime via self-play, synthetic data, and RL.

definitionpending

Speaker

Leopold Aschenbrenner

Evidence Quote

“When you learn by yourself, say you're reading a dense math textbook, you're not just skimming through it once... You read a page, think about it, have some internal monologue going on, and have a conversation with a study buddy. You try a practice problem and fail a bunch of times. At some point it clicks.”

Source

Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:30:02 AM

Your notes

Loading notes...