factual
LeCun's cake: RL is the cherry, not the bulk
Yann LeCun was right in 2016 — controversially at the time when RL was hot — that RL is just the cherry on the cake, supervised learning is the icing, and the bulk of intelligence is in the unsupervised (self-supervised) cake; this turned out to be the recipe for ChatGPT, where most compute goes to next-token pre-training, then supervised fine-tuning, then RLHF for conversational ability.
factualpending
Speaker
Aravind SrinivasEvidence Quote
“And bulk of the intelligence is in the cake and supervised learning is the icing on the cake, and the bulk of the cake is unsupervised”
Created: 6/13/2026, 3:26:05 AM
Your notes
Loading notes...