Deep Learning
A machine learning approach that trains very large tunable circuits (neural networks) on data to perform tasks, without explicitly constructing knowledge representations.
As defined in ms_94
Other definitions
A subfield of machine learning using multi-layered neural networks to learn patterns from large data sets; cited as a research strength of hubs like Montreal.
Amy Webb on Artificial Intelligence, Humanity, and the Big NineMachine learning approach using neural networks with multiple layers; the dominant AI paradigm that relies on gradient descent to train models on massive data and compute
Live: Eliezer Yudkowsky - Is Artificial General Intelligence too Dangerous to Build?
Where it comes up · 57
- Ilya Sutskever: Deep Learning | Lex Fridman Podcast #9412 claims
- Francois Chollet | Why abstraction is the key to intelligence, and what we’re still missing11 claims
- Finally an NVIDIA Competitor for AI? Maybe, RAIN's Brain chips!!!6 claims
- Cognex: Vision Quest5 claims
- Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 20245 claims
- Mustafa Suleyman: The AI Pioneer Reveals the Future in 'The Coming Wave' | Intelligence Squared4 claims
- 312 - The Trouble With Ai4 claims
- Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold4 claims
and 49 more
Most important claims · 10 of 137Search all claims for “Deep Learning” →
- In 2013, Jensen overruled several key lieutenants who believed deep learning was a passing fad, declaring 'Deep learning is going to be really big' and that NVIDIA was going all in on it.#376: Jensen Huang: Founder of Nvidia
- Double descent is a phenomenon where test error exhibits a non-monotonic U-shape as model size increases while data is fixed: performance improves as networks grow, then worsens sharply around the interpolation threshold (where model parameters equal training examples), then improves again as model size continues to grow, and this pattern occurs across virtually all practical deep learning systems without early stopping.Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94
- Gwern foresaw scaling not via a eureka moment but by repeatedly noticing, over years, that dataset sizes, model sizes, and GPU counts kept growing while neural networks kept generalizing to ever-broader use cases, gradually shifting his prior away from the view that algorithms and deep insight are paramount toward the view that intelligence is mostly compute applied to data and parameters.Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary
- The history of machine learning shows paradigms rising and falling by decade: connectionism dominated in the 1950s-60s before symbolists killed it, revived in the 1980s, faded as Bayesians then analogizers ruled, and is now ascendant again as deep learning, illustrating that today's dominant paradigm is not necessarily permanent.Pedro Domingos on Machine Learning and the Master Algorithm
- Today's deep learning systems are powerful but inscrutable black boxes that do impressive things without our understanding why, like children whose neural networks learn to speak English in ways we cannot explain; Tegmark's MIT research focuses on AI transparency—'intelligible intelligence'—transforming neural networks into more understandable systems that perform just as well, which is needed to trust everything from judicial rulings to infrastructure-controlling machines.94 - Frontiers Of Intelligence
- Deep learning as a paradigm (training on data without first-principles reasoning) was highly controversial and niche for a long time, taking decades before it bore fruit; this historical precedent suggests that currently-dismissed approaches or theories may eventually prove fruitful if given time and additional evidence.Terence Tao – How the world’s top mathematician uses AI
- The moment when Google's unprompted AI learned to recognize cats from YouTube videos without explicit instruction was when machine learning transcended memorization and achieved genuine abstraction, learning the essence of what makes a cat a cat rather than just storing specific cat examples.Ex-Google Exec Reveals The Shocking Truth About AI with Mo Gawdat | Bad Decisions Podcast #64
- Hard benchmarks change the field's conversation: when deep learning produces undeniable results on hard problems, debate changes and skepticism shifts, making the availability of rigorous benchmarks central to how machine learning progresses.Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94
- The key breakthrough enabling deep learning's success in 2012 was not a new algorithmic invention but the combination of three factors: large amounts of supervised data from the internet, GPU compute becoming available, and the conviction among researchers like Hinton that scaling neural networks on big data would work when previous skeptics doubted it.Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94
- In 2006, a paper on deep learning co-authored by Hinton, Russ Salakhutdinov, and others was rejected from NIPS because the conference had already accepted another deep learning paper and felt having two papers on deep learning seemed too many for one conference.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024