factual
Intelligent routing drives near-zero marginal inference cost
Application companies can route most tasks to small models and reserve frontier models for a few prompts, producing near-zero inference cost and gross margins around 95 percent for some tasks.
factualpending
Speaker
ChetanEvidence Quote
“we've broken this task up and then we're using these small models for these tasks that are pretty basic, and then the stuff we're hitting with the most frontier models are these very few prompts.”
Created: 11/18/2026, 6:42:24 AM
Your notes
Loading notes...