factual

Post-training is a moat undermined by distillation

Post-training is somewhat of a moat because it is a complex operation requiring much skilled, tacit, and organizational knowledge and accumulated R&D that's non-trivial to spin up; but distillation—cloning another model's outputs or using it as a judge—undercuts this moat, and smaller players likely do this to catch up despite it violating terms of service.

factualpending

Speaker

John Schulman (OpenAI Cofounder)

Evidence Quote

“It's not trivial to spin this up immediately... There's also one force that sort of makes it less of a moat. You can distill the models”

Source

John Schulman (OpenAI Cofounder) — Reasoning, RLHF, & plan for 2027 AGI— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:30 AM

Your notes

Loading notes...