causal
Compute Is Cheap While Data Movement Is Expensive in Chips
Unlike human brains, where storing and loading memory is cheap and math is expensive, chips find loading data very expensive and math very cheap, and math is getting cheaper faster than memory because of fundamental DRAM limits, so models should be designed to use far more compute.
causalpending
Speaker
GavinEvidence Quote
“math gets cheaper at a rate that's faster than memory gets cheaper, due to this fundamental limit on any kind of DRAM device.”
Source
Etched - Building AI Hardware to Make Inference Faster and Cheaper - [Invest Like the Best, EP.480]— Invest Like the BestCreated: 11/17/2026, 7:08:01 AM
Your notes
Loading notes...