normative
Blurry-JPEG Metaphor Misleads on Generation
Ted Chiang's metaphor of ChatGPT as a 'blurry JPEG of the web' captures the real connection between machine learning and compression but misleads about generation, because it suggests output is mere shallow interpolation amounting to approximate memorization, whereas inference in these models is more genuinely novel and generative than nearest-neighbor pixel interpolation.
normativepending
Speaker
Raphael MilliereEvidence Quote
“I think comparing it to lossy image decompression is pumping the wrong intuitions”
Created: 6/13/2026, 12:19:51 AM
Your notes
Loading notes...