← Jargon

Jargonmachine learning· 11 claims· 7 episodes

MoE

Mixture of Experts — a sparse model architecture where only some sub-networks (experts) activate per input, requiring load balancing across them.

As defined in Is RL + LLMs enough for AGI? — Sholto Douglas & Trenton Bricken


Where it comes up · 7

Most important claims · 10 of 11Search all claims for “MoE” →