Causal architectures in autoregressive generation prevent cheating (using future tokens to predict past ones) by restricting the transformer to only look at previous tokens in the sequence.

definitionpending

Speaker

Yann LeCun

Evidence Quote

“it cannot cheat and use a particular input to predict itself it has to only look at the symbols that are to the left of it that's called causal architecture”

Source

The Shape of AI to Come! Yann LeCun at AI Action Summit 2025— DSAI by Dr. Osbert Tay
Created: 8/11/2026, 7:07:43 AM

Your notes

Loading notes...