← Jargon

Jargonmachine learning· 14 claims· 7 episodes

bitter lesson

The thesis that general methods leveraging more computation ultimately outperform approaches relying on human-engineered domain knowledge.

As defined in Dwarkesh Patel Podcast - Eric Jang – Building AlphaGo from scratch


Other definitions
  • Sutton's principle that general methods leveraging computation scale better than approaches relying on human-engineered knowledge; reframed here as finding techniques that most effectively and scalably use compute.

    Some thoughts on the Sutton interview
  • In machine learning, the principle that simpler, more general approaches that leverage raw compute and data scale outperform complex, engineered solutions incorporating domain knowledge

    Your AI Stack Isn't Ready for Claude Mythos

Where it comes up · 7

Most important claims · 10 of 14Search all claims for “bitter lesson” →