factual

Interpolation Equals Extrapolation in High Dimensions

In very high-dimensional spaces, interpolation becomes equivalent to extrapolation (per a paper by Yann LeCun and colleagues), so the intuitions we have about interpolation in narrow low-dimensional domains break down, making the interpolation/extrapolation distinction blur and rendering the lossy-decompression analogy unhelpful for understanding generative models.

factualpending

Speaker

Raphael Milliere

Evidence Quote

“when you have so many dimensions, the kind of intuitions you have about interpolation in a specific narrow domain don't really hold anymore.”

Source

230 | Raphaël Millière on How Artificial Intelligence Thinks— Sean Carroll's Mindscape
Created: 6/13/2026, 12:19:51 AM

Your notes

Loading notes...