← Jargon

Jargonmachine learning· 12 claims· 3 episodes

representation collapse

A failure mode in joint embedding architectures where the network learns a trivial solution that outputs identical embeddings for all inputs, avoiding useful feature learning

As defined in Yann LeCun's $1B Bet Against LLMs [Part 1]


Other definitions
  • A failure mode in self-supervised learning where the encoder outputs the same constant embedding for all inputs, causing the embedding space to collapse into a single point with no useful information despite low training loss

    What Is Yann LeCun Cooking? JEPA Explained Simply

Where it comes up · 3