← Jargon

Jargonmachine learning· 10 claims· 2 episodes

pipeline parallelism

Splitting a model's layers across different racks so each rack processes a different stage of the forward pass.

As defined in Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served


Other definitions

Where it comes up · 2