JEPA
Joint-Embedding Predictive Architecture: a model that encodes both a full input and a corrupted version, then predicts the abstract representation of the full input from the corrupted one, rather than reconstructing raw pixels.
As defined in Research Pioneer
Where it comes up · 5
- What Is Yann LeCun Cooking? JEPA Explained Simply11 claims
- Yann LeCun: Special Lecture on AI and World Models8 claims
- Yann LeCun's $1B Bet Against LLMs [Part 1]5 claims
- Research Pioneer3 claims
- Metas AI Boss Says He DONE With LLMS...2 claims
Most important claims · 10 of 29Search all claims for “JEPA” →
- Inference in JEPA-based systems becomes a search process over predicted futures rather than autoregressive prediction, fundamentally changing how these systems generate behavior.Yann LeCun's $1B Bet Against LLMs [Part 1]
- JEPA (Joint Embedding Predictive Architecture) avoids the pixel prediction problem by mapping observations to embeddings and training a predictor to forecast future embeddings rather than pixels, allowing the model to focus on salient scene features instead of random unpredictable details.Yann LeCun's $1B Bet Against LLMs [Part 1]
- VJEPA-2 conditions JEPA on action signals sent to a robot arm, allowing the predictor to learn how control signals change the robot's position in embedded space, enabling planning by exploring the model's predictions to find actions matching a goal state.Yann LeCun's $1B Bet Against LLMs [Part 1]
- A world model predicts the state of the world at time T+1 given the current state and a candidate action, which enables planning by allowing a system to imagine the outcomes of action sequences and select those that satisfy an objective — something LLMs cannot do.Research Pioneer
- Joint-Embedding Predictive Architecture (JEPA) trains by encoding both a full input and a corrupted version, then predicting the representation of the full input from the corrupted one in abstract representation space, rather than reconstructing pixels; this lets the encoder discard unpredictable noise and preserve only predictable, modelable structure.Research Pioneer
- JEPA (Joint Embedding Predictive Architecture) models learn abstract representations and are capable of manipulating those representations, reasoning, and producing sequences of actions to arrive at particular goals.Metas AI Boss Says He DONE With LLMS...
- Representation collapse is a failure mode where both the context and target encoders in JEPA can learn to output the same constant embedding for all inputs, with the predictor simply outputting a constant embedding that always matches, resulting in extremely low training loss but learning absolutely nothing about the world.What Is Yann LeCun Cooking? JEPA Explained Simply
- JEPA performs world simulation directly in latent space where action sequences and state transitions are represented as embeddings, saving compute compared to generating full video frames by operating in representation space rather than pixel space.What Is Yann LeCun Cooking? JEPA Explained Simply
- For complex JEPA applications, the latent space must be structured to support planning, with the predictor learning smooth transitions between states through conditional actions, so changes in latent state make sense and predicted trajectories don't drift or accumulate errors.What Is Yann LeCun Cooking? JEPA Explained Simply
- LeJepa can train JEPA-style models without relying on EMA while still avoiding collapse and learning strong representations, achieving competitive or better performance compared to VICReg, Barlow Twins, and SimCLR on standard vision benchmarks, with accuracy levels similar to state-of-the-art DINO on ImageNet.What Is Yann LeCun Cooking? JEPA Explained Simply