ChatGPT released in 2022 represented the culmination of aggressive scaling of the GPT approach, but the underlying architecture and pre-training method remained essentially unchanged from GPT-1.

factualpending

Speaker

Unidentified Speaker — Yann LeCun's $1B Bet Against LLMs [Part 1] [kYkIdXwW2AE]

Evidence Quote

“aggressively scaling up to GPT-2 in 2019, GPT-3 in 2020, and ChatGPT in 2022”

Source

Yann LeCun's $1B Bet Against LLMs [Part 1]— Welch Labs
Created: 8/12/2026, 6:35:53 PM

Your notes

Loading notes...