causal
Compression Into Weights Aids Generalization
Human learning compresses observations into intuitions and big-picture knowledge in the weights, which aids generalization and grokking, whereas perfect-fidelity recall of raw information, as in some savants, can cripple the ability to understand abstractions and metaphors.
causalpending
Speaker
Dwarkesh PatelEvidence Quote
“Human continual learning is less about having all your observations at the tip of your tongue, and more about chiseling the right intuitions and big picture knowledge back into the weights.”
Source
Dwarkesh Patel Podcast - The next big breakthrough will be AIs learning on the job— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:25:50 AM
Your notes
Loading notes...