forecast
Claude 7 could invent transformer-like breakthroughs
Because matching dozens of idea combinations is what AIs are disproportionately skilled at, a model like Claude 7 could invent something as large as the transformer if Chris Olah asked it to hard enough to improve attention.
forecastpending
Speaker
Dwarkesh PatelEvidence Quote
“the transformer ... is the kind of thing that Claude 7 could invent if Chris Olah asked it to try hard”
Source
Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:27:26 AM
Your notes
Loading notes...