Digital computation is far more expensive in terms of energy consumption than analog neural computation because digital systems require precise manufacturing of identical hardware components, whereas analog hardware can leverage inherent nonlinearities and requires only tens of watts compared to megawatts for training large language models on GPUs.
causalpending
Speaker
Geoffrey HintonEvidence Quote
“when you train it you're probably using megawatts because you're running it on lots of different gpus we run on like 30 Watts so incredibly much more power efficient”
Source
Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024— Vector InstituteCreated: 8/11/2026, 6:32:35 AM
Your notes
Loading notes...