causal

AlexNet Breakthrough Came From Cheap Hardware

Around 2012, fringe researchers used two ~$1,000 NVIDIA GPUs and CUDA to jerry-rig a supercomputer that simulated brain neurons, producing AlexNet—suddenly computers could identify images with unprecedented accuracy on cheap commodity hardware, proving the missing ingredient for neural nets was firepower and inaugurating NVIDIA's AI phase.

causalpending

Speaker

Stephen Witt

Evidence Quote

“they get ahold of two GPUs--two NVIDIA graphics cards. Total costs about $1,000. And they use CUDA, this platform, to jerry-rig a supercomputer; they start simulating the neurons of the human brain on this, like, tiny home-brew supercomputer. And, they usher in a scientific revolution”

Source

The Man Who Built NVIDIA (with Stephen Witt)— EconTalk
Created: 6/13/2026, 12:20:22 AM

Your notes

Loading notes...