Distillation Learning

Definition

A method of knowledge transfer where a student system learns by observing and mimicking a teacher system's responses, particularly effective when the teacher provides probability distributions over incorrect outputs rather than just correct labels. The relative probabilities of wrong answers encode important structural information about categories.

Cast within

No topic-region cast yet — this appears once Distillation Learning's compiled claims are aligned into a topic region's argument tree.

Claims mentioning Distillation Learning (1)

Your notes

Loading notes...