factual
Big Blob of Compute Hypothesis governs scaling
All the cleverness and techniques matter very little; only a few things matter for AI progress: raw compute, quantity of data, quality/breadth of data distribution, training duration, an objective function that can scale indefinitely (pre-training or RL), and numerical stability (normalization/conditioning) so compute flows in a laminar way.
factualpending
Speaker
Dario AmodeiEvidence Quote
“One is how much raw compute you have. The second is the quantity of data. The third is the quality and distribution of data... The fifth is that you need an objective function that can scale to the moon.”
Source
Dwarkesh Patel Podcast - Dario Amodei — "We are near the end of the exponential"— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:32:46 AM
Your notes
Loading notes...