factual

Sample efficiency progress unclear despite broader data

It is not clear that AI labs have made much progress on training sample efficiency in recent years; instead, progress has come mainly from dramatically widening and improving the data distribution.

factualpending

Speaker

Dwarkesh Patel

Evidence Quote

“It’s not clear that we’ve actually made much progress on training sample efficiency over the last few years”

Source

Dwarkesh Patel Podcast - The data black hole at the center of AI— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:11:50 AM

Your notes

Loading notes...