forecast
Longer in-context sessions may solve continual learning
Scaling in-context learning so sessions last many months may be enough for a single AI instance to learn on the job effectively, without an architectural breakthrough that updates weights at the end of each session.
forecastpending
Speaker
Dwarkesh PatelEvidence Quote
“scaling up in-context learning, so that you have sessions that are effectively many months long, will probably be enough”
Source
Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:27:26 AM
Your notes
Loading notes...