When distilled models copy the teacher too closely, they sometimes identify themselves as the teacher—e.g., claiming they are ChatGPT—because the student absorbs the teacher's phrasing, formatting, verbal tics, and identity markers along with the skills.

factualpending

Speaker

Unidentified Speaker — Model Distillation: How to Steal a Billion-Dollar AI [gacMZf5rqYA]

Evidence Quote

“Ask some of these distilled models who they were, and they would sometimes say they were chat GPT... The phrasing, the formatting, the verbal tics, all of it travels with the skills.”

Source

Model Distillation: How to Steal a Billion-Dollar AI— Kai
Created: 8/12/2026, 2:31:09 AM

Your notes

Loading notes...