forecast

Longer in-context sessions may solve continual learning

Scaling in-context learning so sessions last many months may be enough for a single AI instance to learn on the job effectively, without an architectural breakthrough that updates weights at the end of each session.

forecastpending

Speaker

Dwarkesh Patel

Evidence Quote

“scaling up in-context learning, so that you have sessions that are effectively many months long, will probably be enough”

Source

Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:27:26 AM

Your notes

Loading notes...