L2 memory
A second-level shared cache in the middle of a GPU connecting the grid of SMs.
As defined in Dwarkesh Patel Podcast - Reiner Pope – Chip design from the bottom up
Where it comes up · 1
Most important claims · 1 of 1Search all claims for “L2 memory” →
- At the top level a GPU is a regular grid of near-identical SMs around an L2 memory, while a TPU is a few coarse-grained matrix units (large systolic arrays) with a vector unit in the middle; since an SM is essentially a scaled-down matrix unit plus small vector unit, a GPU can be understood as a lot of tiny TPUs tiled across the whole chip.Dwarkesh Patel Podcast - Reiner Pope – Chip design from the bottom up