local minima
In the context of knowledge creation and societal improvement, a state where a system is trapped in a suboptimal configuration and cannot escape without destroying current structures, making progress impossible
As defined in David Deutsch: Knowledge Creation and The Human Race, Part 1
Where it comes up · 3
- Machine Learning in Investing2 claims
- David Deutsch: Knowledge Creation and The Human Race, Part 12 claims
- Geoffrey Hinton - Two Paths to Intelligence1 claim
Most important claims · 5 of 5Search all claims for “local minima” →
- North Korea represents a case where humanity is trapped in a local minimum because the regime has destroyed the means of political error correction through elections and revolution, preventing improvement even though better solutions exist.David Deutsch: Knowledge Creation and The Human Race, Part 1
- For decades many researchers assumed neural networks would get stuck in local minima during training. People never actually checked if this was true—they just assumed it. In fact, it's not true, and even if it were, good local minima would make the assumption irrelevant. This shows the importance of empirical testing over pure theorizing.Geoffrey Hinton - Two Paths to Intelligence
- The basis of morality is not destroying the means of error correction; if there is no way to correct errors, sooner or later one will destroy the civilization, making preservation of error-correcting institutions (like elections and free inquiry) the foundation of ethics.David Deutsch: Knowledge Creation and The Human Race, Part 1
- Gradient descent trains models by measuring the error surface and repeatedly stepping parameters in the steepest downhill direction, like a marble rolling down a mountain until it reaches a low point.Machine Learning in Investing
- Plain gradient descent can get stuck in local minima, a valley far above sea level; adding momentum, which carries parameters in their prior direction, helps the optimizer avoid such traps.Machine Learning in Investing