normative
Trading compute for memory is generally profitable
Given current hardware economics, spending extra compute to save memory (as in RevNets rematerialization) is generally profitable, which is the inverse of the KV cache strategy where you spend extra memory to save compute.
normativepending
Speaker
Reiner PopeEvidence Quote
“Spending more memory to save compute is generally profitable given where hardwares are.”
Source
Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:34:09 AM
Your notes
Loading notes...