factual

Neural nets' noise tolerance hides bugs

Neural nets are so tolerant of noise that bugs in the code often do nothing, sometimes make the model worse, and sometimes make it better—so misconfigurations slip through silently, and occasionally a bug never tried at scale leads to discovering something new because the model simply learns to work around problems.

factualpending

Speaker

Jeff Dean & Noam Shazeer

Evidence Quote

“they're so tolerant of noise. You can have things set up kind of wrong in a lot of ways, and they just figure out ways to work around that or learn.”

Source

Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:30:41 AM

Your notes

Loading notes...