normative
Action-taking models would be more sample-efficient
Humans are sample-efficient partly because they explore the world and take actions and observe results—infants learn gravity by dropping things, which is much harder to learn when not initiating the action—so a model that can take actions as part of its learning process and observe corresponding results would be far better than one passively observing a giant dataset, and much can even be learned from thought experiments and self-play without external input (as in chess from only the rules).
normativepending
Speaker
Jeff Dean & Noam ShazeerEvidence Quote
“having a model that can take actions as part of its learning process would be just a lot better than just sort of passively observing a giant dataset.”
Created: 6/13/2026, 3:30:41 AM
Your notes
Loading notes...