forecast

Automated idea search could speed ML research 100x

If machine learning researchers gently steer a more automated search process rather than hand-babysitting experiments, they could vet 100 times more ideas faster, winnowing promising ones at small scale and bringing them into production training—because a brilliant ML idea has only about a 2% chance of working, so trying hundreds, thousands, or a million ideas is how breakthroughs happen, and top labs already have roughly a million times the compute it took to train the original Transformer.

forecastpending

Speaker

Jeff Dean & Noam Shazeer

Evidence Quote

“if you try 100 things or 1,000 things or a million things, then you might hit on something amazing. We have plenty of compute. Like modern top labs these days have probably a million times as much compute as it took to train Transformer.”

Source

Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:30:41 AM

Your notes

Loading notes...