causal

Memorization-Generalization Tradeoff in Brains and LLMs

There appears to be a tradeoff between perfect memorization and generalization: a person with perfect, never-forgetting memory was too trapped in details to extract generalizable insights, paralleling how LLMs nail exact phrasing of training text but fail to generalize, while humans (and especially children) forget details yet learn well.

causalpending

Speaker

Trenton Bricken

Evidence Quote

“are too trapped in the details to extract any meaningful generalizable insights from it”

Source

AMA: career advice given AGI, how I research ft. Sholto & Trenton— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:36:46 AM

Your notes

Loading notes...