A June 2025 study from Yage AI found distilled R1 scored 14.7% lower than Qwen base on medical tasks because mathematical reasoning frameworks come through but domain-specific clinical pattern recognition stays with the teacher.

factualpending

Speaker

Unidentified Speaker — Model Distillation: How to Steal a Billion-Dollar AI [gacMZf5rqYA]

Evidence Quote

“A June 2025 study cited an analysis from Yage AI found the distilled R1 scored 14.7% lower than the Qwen base on medical tasks.”

Source

Model Distillation: How to Steal a Billion-Dollar AI— Kai
Created: 8/12/2026, 2:31:09 AM

Your notes

Loading notes...