forecast

Mid-Sized Models Lose to Small Edge and Giant Cloud

The future of models splits into very small on-device transformers for low-latency tasks like autocomplete and giant hyperscale models, while mid-sized models around 100 billion parameters have no niche because they are too big for devices and too small to justify compared with data center models.

forecastpending

Speaker

Gavin

Evidence Quote

“I think we're going to see promising future for edge and a promising future for the biggest of the big and these hyperscale data centers and nothing in between.”

Source

Gavin Uberti - Real-Time AI & The Future of AI Hardware - [Invest Like the Best, EP.356]— Invest Like the Best
Created: 11/17/2026, 12:35:53 PM

Your notes

Loading notes...