factual

Big Blob of Compute Hypothesis governs scaling

All the cleverness and techniques matter very little; only a few things matter for AI progress: raw compute, quantity of data, quality/breadth of data distribution, training duration, an objective function that can scale indefinitely (pre-training or RL), and numerical stability (normalization/conditioning) so compute flows in a laminar way.

factualpending

Speaker

Dario Amodei

Evidence Quote

“One is how much raw compute you have. The second is the quantity of data. The third is the quality and distribution of data... The fifth is that you need an objective function that can scale to the moon.”

Source

Dwarkesh Patel Podcast - Dario Amodei — "We are near the end of the exponential"— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:32:46 AM

Your notes

Loading notes...