definition

Three Computation Paradigms: CPU, GPU, DSP

There are three computation paradigms: CPUs can do everything fast including compare and branch via branch prediction and speculative execution; GPUs can do arbitrary load/store and data-dependent fetches but are horrendously slow at branching; and DSPs do only statically scheduled adds and multiplies — and 95% of neural networks fit the DSP paradigm of statically scheduled adds and multiplies.

definitionpending

Speaker

George Hotz

Evidence Quote

“95% of neural networks are all the DSP paradigm. They are just statically scheduled adds and multiplies.”

Source

George Hotz #3— Lex Fridman Podcast
Created: 6/13/2026, 12:26:10 AM

Your notes

Loading notes...