definition
π0 is a VLM with a grafted continuous action expert
The π0 model is a vision-language model adapted for motor control: it reads robot sensory input, does internal processing including chain-of-thought intermediate steps, and routes to an action expert (a separate module because actions are continuous and high-frequency) within an end-to-end transformer structured as a mixture-of-experts.
definitionpending
Speaker
Sergey LevineEvidence Quote
“structurally it's still an end-to-end transformer. Roughly speaking, technically, it corresponds to a mixture-of-experts architecture.”
Source
Fully autonomous robots are much closer than you think – Sergey Levine— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:29:18 AM
Your notes
Loading notes...