normative

Trading compute for memory is generally profitable

Given current hardware economics, spending extra compute to save memory (as in RevNets rematerialization) is generally profitable, which is the inverse of the KV cache strategy where you spend extra memory to save compute.

normativepending

Speaker

Reiner Pope

Evidence Quote

“Spending more memory to save compute is generally profitable given where hardwares are.”

Source

Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:09 AM

Your notes

Loading notes...