forecast

Claude 7 could invent transformer-like breakthroughs

Because matching dozens of idea combinations is what AIs are disproportionately skilled at, a model like Claude 7 could invent something as large as the transformer if Chris Olah asked it to hard enough to improve attention.

forecastpending

Speaker

Dwarkesh Patel

Evidence Quote

“the transformer ... is the kind of thing that Claude 7 could invent if Chris Olah asked it to try hard”

Source

Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:27:26 AM

Your notes

Loading notes...