normative
Required Gains: 100x Cheaper, 10x Lower Latency
To enable the next wave of uses such as tree search and speech conversation, inference must become roughly 100x cheaper, latency must drop by an order of magnitude, and systems should generate about 1,000 tokens per second so code writing takes seconds instead of tens of seconds.
normativepending
Speaker
GavinEvidence Quote
“we need tech that will bring the latency down by an order of magnitude”
Source
Gavin Uberti - Real-Time AI & The Future of AI Hardware - [Invest Like the Best, EP.356]— Invest Like the BestCreated: 11/17/2026, 12:35:53 PM
Your notes
Loading notes...