normative

Always initialize experiments close to success

In deep learning, initialization is everything: you should always initialize a research project as close to success as possible—starting with something that works (e.g., supervised learning on expert data) and then improving it—rather than starting from something that doesn't work at all and trying to make it work.

normativepending

Speaker

Eric Jang

Evidence Quote

“Always pick something that works and then get it to do something better, rather than start from something that doesn't work at all and try to make it work.”

Source

Dwarkesh Patel Podcast - Eric Jang – Building AlphaGo from scratch— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:56 AM

Your notes

Loading notes...