Self-supervised learning achieved success in language (next-token prediction) much faster than in vision and other modalities, suggesting language is a particularly rich and informative domain for self-supervised pre-training.
factualpending
Speaker
Yann LeCunEvidence Quote
“the success of self-supervised learning uh you know, happened in in text and and language way faster than it did in sort of more uh you know, natural uh modalities like like vision”
Created: 8/12/2026, 6:35:53 PM
Your notes
Loading notes...