However, by 2021 fully supervised approaches like Google's Vision Transformer achieved 88.6% ImageNet accuracy, showing self-supervised methods were still inferior despite Barlow Twins' breakthrough.

factualpending

Speaker

Unidentified Speaker — Yann LeCun's $1B Bet Against LLMs [Part 1] [kYkIdXwW2AE]

Evidence Quote

“In 2020, a team at Google applied the transformer architecture to image classification, achieving a new state-of-the-art ImageNet accuracy of 88.6%”

Source

Yann LeCun's $1B Bet Against LLMs [Part 1]— Welch Labs
Created: 8/12/2026, 6:35:53 PM

Your notes

Loading notes...