normative

Required Gains: 100x Cheaper, 10x Lower Latency

To enable the next wave of uses such as tree search and speech conversation, inference must become roughly 100x cheaper, latency must drop by an order of magnitude, and systems should generate about 1,000 tokens per second so code writing takes seconds instead of tens of seconds.

normativepending

Speaker

Gavin

Evidence Quote

“we need tech that will bring the latency down by an order of magnitude”

Source

Gavin Uberti - Real-Time AI & The Future of AI Hardware - [Invest Like the Best, EP.356]— Invest Like the Best
Created: 11/17/2026, 12:35:53 PM

Your notes

Loading notes...