factual
Post-training is a moat undermined by distillation
Post-training is somewhat of a moat because it is a complex operation requiring much skilled, tacit, and organizational knowledge and accumulated R&D that's non-trivial to spin up; but distillation—cloning another model's outputs or using it as a judge—undercuts this moat, and smaller players likely do this to catch up despite it violating terms of service.
factualpending
Evidence Quote
“It's not trivial to spin this up immediately... There's also one force that sort of makes it less of a moat. You can distill the models”
Source
John Schulman (OpenAI Cofounder) — Reasoning, RLHF, & plan for 2027 AGI— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:34:30 AM
Your notes
Loading notes...