forecast

Continual learning will be gradual like in-context learning

Solving continual learning won't be a singular one-and-done achievement but will resemble in-context learning: just as GPT-3 demonstrated powerful but unfinished ICL that required years of further progress, labs will release something they call continual learning next year that counts as real progress, but human-level continual learning may take another 5 to 10 years.

forecastpending

Speaker

Dwarkesh Patel

Evidence Quote

“human level continual learning may take another 5 to 10 years of further progress”

Source

An audio version of my blog post, Thoughts on AI progress (Dec 2025)— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:40 AM

Your notes

Loading notes...