White box distillation—accessing a model's internal probability distributions—requires owning the model; outside laboratories like OpenAI or Google, users only have access to public APIs that return text outputs, forcing reliance on weaker black box distillation signals.

factualpending

Speaker

Unidentified Speaker — Model Distillation: How to Steal a Billion-Dollar AI [gacMZf5rqYA]

Evidence Quote

“You can only read a model's internal probabilities if you own the model... All you get is the public API.”

Source

Model Distillation: How to Steal a Billion-Dollar AI— Kai
Created: 8/12/2026, 2:31:09 AM

Your notes

Loading notes...