The gap between teacher and student is real and grows in specific ways; on AIME 2024, the full R1 teacher scores 79.8 while the 32B student scores 72.6, a 7-point gap.

factualpending

Speaker

Unidentified Speaker — Model Distillation: How to Steal a Billion-Dollar AI [gacMZf5rqYA]

Evidence Quote

“On AIM 2024, the full R1 teacher scores 79.8. The 32B student scores 72.6, a 7-point gap, real.”

Source

Model Distillation: How to Steal a Billion-Dollar AI— Kai
Created: 8/12/2026, 2:31:09 AM

Your notes

Loading notes...