GPT-2 (2019) and GPT-3 (2020) were created by aggressively scaling up the GPT-1 approach, with GPT-3 achieving state-of-the-art results across a much broader range of language tasks through sheer scale.

factualpending

Speaker

Unidentified Speaker — Yann LeCun's $1B Bet Against LLMs [Part 1] [kYkIdXwW2AE]

Evidence Quote

“aggressively scaling up to GPT-2 in 2019, GPT-3 in 2020, and ChatGPT in 2022”

Source

Yann LeCun's $1B Bet Against LLMs [Part 1]— Welch Labs
Created: 8/12/2026, 6:35:53 PM

Your notes

Loading notes...