← Jargon

Jargonmachine learning· 3 claims· 2 episodes

dark knowledge

The extra information contained in a model's full soft output distribution (relative probabilities of all classes) beyond the single correct label, exploited during distillation.

As defined in Dwarkesh Patel Podcast - Eric Jang – Building AlphaGo from scratch


Where it comes up · 2

Most important claims · 3 of 3Search all claims for “dark knowledge” →