forecast
Automated idea search could speed ML research 100x
If machine learning researchers gently steer a more automated search process rather than hand-babysitting experiments, they could vet 100 times more ideas faster, winnowing promising ones at small scale and bringing them into production training—because a brilliant ML idea has only about a 2% chance of working, so trying hundreds, thousands, or a million ideas is how breakthroughs happen, and top labs already have roughly a million times the compute it took to train the original Transformer.
forecastpending
Speaker
Jeff Dean & Noam ShazeerEvidence Quote
“if you try 100 things or 1,000 things or a million things, then you might hit on something amazing. We have plenty of compute. Like modern top labs these days have probably a million times as much compute as it took to train Transformer.”
Created: 6/13/2026, 3:30:41 AM
Your notes
Loading notes...