normative

Action-taking models would be more sample-efficient

Humans are sample-efficient partly because they explore the world and take actions and observe results—infants learn gravity by dropping things, which is much harder to learn when not initiating the action—so a model that can take actions as part of its learning process and observe corresponding results would be far better than one passively observing a giant dataset, and much can even be learned from thought experiments and self-play without external input (as in chess from only the rules).

normativepending

Speaker

Jeff Dean & Noam Shazeer

Evidence Quote

“having a model that can take actions as part of its learning process would be just a lot better than just sort of passively observing a giant dataset.”

Source

Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:30:41 AM

Your notes

Loading notes...