factual
Interpolation Equals Extrapolation in High Dimensions
In very high-dimensional spaces, interpolation becomes equivalent to extrapolation (per a paper by Yann LeCun and colleagues), so the intuitions we have about interpolation in narrow low-dimensional domains break down, making the interpolation/extrapolation distinction blur and rendering the lossy-decompression analogy unhelpful for understanding generative models.
factualpending
Speaker
Raphael MilliereEvidence Quote
“when you have so many dimensions, the kind of intuitions you have about interpolation in a specific narrow domain don't really hold anymore.”
Created: 6/13/2026, 12:19:51 AM
Your notes
Loading notes...