← Jargon

Jargonmachine learning· 3 claims· 3 episodes

flash attention

An efficiency-improving algorithmic technique for computing attention in transformer models, cited as an example of software innovations that speed up effective compute.

As defined in Carl Shulman (Pt 1) — Intelligence explosion, primate evolution, robot doublings, & alignment


Where it comes up · 3