DINO
A self-supervised distillation method developed at FAIR for learning image representations using image-specific transformations like geometry changes and blurring.
As defined in Research Pioneer
Where it comes up · 6
- Yann LeCun's $1B Bet Against LLMs [Part 1]4 claims
- What Is Yann LeCun Cooking? JEPA Explained Simply2 claims
- The Shape of AI to Come! Yann LeCun at AI Action Summit 20252 claims
- Yann LeCun: World Models: Enabling the next AI revolution1 claim
- Research Pioneer1 claim
- Yann LeCun: Special Lecture on AI and World Models1 claim
Most important claims · 10 of 11Search all claims for “DINO” →
- In 2022, Yann LeCun published 'A Path Towards Autonomous Machine Intelligence,' a 60-page position paper that synthesized Barlow Twins, VICReg, DINO, and other work into a holistic framework for building intelligent machines, arguing world models are the missing piece.Yann LeCun's $1B Bet Against LLMs [Part 1]
- VICReg is a simplified version of Barlow Twins that turned out to be quite effective, and DINO is a similar joint embedding technique developed by colleagues at Meta's Paris lab, demonstrating convergence on joint embedding approaches for vision.Yann LeCun's $1B Bet Against LLMs [Part 1]
- DINO outputs an embedding vector for each patch of an image and can perform object segmentation by comparing patch embeddings to reference patches without any segmentation labels, demonstrating the quality of learned representations.Yann LeCun's $1B Bet Against LLMs [Part 1]
- LeJepa can train JEPA-style models without relying on EMA while still avoiding collapse and learning strong representations, achieving competitive or better performance compared to VICReg, Barlow Twins, and SimCLR on standard vision benchmarks, with accuracy levels similar to state-of-the-art DINO on ImageNet.What Is Yann LeCun Cooking? JEPA Explained Simply
- DINO V3, released August 2025, achieved 88.4% ImageNet accuracy using joint embedding architecture, marking the first time self-supervised vision models matched state-of-the-art weakly-supervised and supervised models on image classification.Yann LeCun's $1B Bet Against LLMs [Part 1]
- JEPA architectures can be trained with non-contrastive methods (distillation-based like BYOL and I-JEPA, or regularized like VICReg) rather than contrastive methods, avoiding the need for a gigantic number of negative contrastive samples when the answer space is large.Research Pioneer
- Early JEPA experiments like I-JEPA (image generation), V-JEPA (video generation), and DINO (self-supervised vision) all utilized exponential moving average, though EMA is ultimately a training trick rather than a principled objective since there is no loss function for EMA to minimize.What Is Yann LeCun Cooking? JEPA Explained Simply
- DINO (Self-Supervised Vision Transformers for Image Representation) is the state-of-the-art method for extracting generic features from images without labels, now at version DINO V3, and represents the best system globally for image representation learning.Yann LeCun: Special Lecture on AI and World Models
- DINO (self-distillation with no labels) and its variants learn generic image features that transfer well to downstream tasks by using the distillation approach without negative samples, enabling efficient self-supervised learningThe Shape of AI to Come! Yann LeCun at AI Action Summit 2025
- Experiments demonstrate that DINO world models can plan object manipulation by optimizing action sequences: pushing T-shaped objects into target positions and manipulating scattered blue chips, showing learned models capture interaction dynamics without explicit physical simulationThe Shape of AI to Come! Yann LeCun at AI Action Summit 2025