definition

A GPU is many tiny TPUs tiled across the chip

At the top level a GPU is a regular grid of near-identical SMs around an L2 memory, while a TPU is a few coarse-grained matrix units (large systolic arrays) with a vector unit in the middle; since an SM is essentially a scaled-down matrix unit plus small vector unit, a GPU can be understood as a lot of tiny TPUs tiled across the whole chip.

definitionpending

Speaker

Reiner Pope

Evidence Quote

“From a very high-level point of view, the GPU has a lot of tiny TPUs tiled across the whole chip.”

Source

Dwarkesh Patel Podcast - Reiner Pope – Chip design from the bottom up— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:33:43 AM

Your notes

Loading notes...