factual
Neural nets' noise tolerance hides bugs
Neural nets are so tolerant of noise that bugs in the code often do nothing, sometimes make the model worse, and sometimes make it better—so misconfigurations slip through silently, and occasionally a bug never tried at scale leads to discovering something new because the model simply learns to work around problems.
factualpending
Speaker
Jeff Dean & Noam ShazeerEvidence Quote
“they're so tolerant of noise. You can have things set up kind of wrong in a lot of ways, and they just figure out ways to work around that or learn.”
Created: 6/13/2026, 3:30:41 AM
Your notes
Loading notes...