Geoffrey Hinton, Oriol Vinyals, and Jeff Dean wrote the foundational distillation paper at Google in 2015 and gave the useful signal concept the name 'dark knowledge'.

factualpending

Speaker

Unidentified Speaker — Model Distillation: How to Steal a Billion-Dollar AI [gacMZf5rqYA]

Evidence Quote

“Back in 2015, Geoffrey Hinton, Oriol Vinyals, and Jeff Dean wrote it up at Google and gave the useful leftover signal a name, dark knowledge.”

Source

Model Distillation: How to Steal a Billion-Dollar AI— Kai
Created: 8/12/2026, 2:31:09 AM

Your notes

Loading notes...