factual

LLMs lack culture and self-play

LLMs lack two powerful multi-agent ideas: culture (a growing repertoire of knowledge they write down and share, like one LLM writing a book for others) and self-play (LLMs generating progressively harder problems for each other to solve, as AlphaGo did against itself); both remain unclaimed research realms, which is one reason the field is still early.

factualpending

Speaker

Andrej Karpathy

Evidence Quote

“Why can't an LLM write a book for the other LLMs?... Why can't an LLM for example, create a bunch of problems that another LLM is learning to solve?”

Source

Andrej Karpathy — AGI is still a decade away— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:26:44 AM

Your notes

Loading notes...