factual

LeCun's cake: RL is the cherry, not the bulk

Yann LeCun was right in 2016 — controversially at the time when RL was hot — that RL is just the cherry on the cake, supervised learning is the icing, and the bulk of intelligence is in the unsupervised (self-supervised) cake; this turned out to be the recipe for ChatGPT, where most compute goes to next-token pre-training, then supervised fine-tuning, then RLHF for conversational ability.

factualpending

Speaker

Aravind Srinivas

Evidence Quote

“And bulk of the intelligence is in the cake and supervised learning is the icing on the cake, and the bulk of the cake is unsupervised”

Source

Aravind Srinivas— Lex Fridman Podcast
Created: 6/13/2026, 3:26:05 AM

Your notes

Loading notes...