factual
Model Serving Monetization Adds GPU Costs
Model serving, where Databricks hosts customers' LLM-based endpoints as APIs, is a monetization area customers increasingly request, and it carries GPU costs, though these are a very different order of magnitude from those of AI-native companies.
factualpending
Speaker
AlanEvidence Quote
“in those situations, Databricks will actually have GPU costs underneath that. But again, relative to some of the other examples out there in terms of the scale of cost, it's a very different order of magnitude.”
Created: 11/17/2026, 1:12:25 PM
Your notes
Loading notes...