factual

Compute multipliers are transitory as hardware improves

The benefit of any given algorithmic compute-multiplier is likely transitory: many of KataGo's clever tricks (architecture choices, auxiliary supervision objectives, asynchronous distributed setups) matter much less on faster modern GPUs like Blackwell, and three years out they may stack even worse—so research taste is knowing how much the Bitter Lesson can buy at any given moment.

factualpending

Speaker

Eric Jang

Evidence Quote

“with modern Blackwell GPUs and Ada-class GPUs... some of these algorithmic tricks to speed up convergence just don't matter so much compared to something else.”

Source

Dwarkesh Patel Podcast - Eric Jang – Building AlphaGo from scratch— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:56 AM

Your notes

Loading notes...