Neural networks fail at extrapolation: training a neural net to reproduce a sine curve in one region and then asking it to extrapolate beyond that region produces terrible results, even when the network size is increased.
factualpending
Speaker
Stephen WolframEvidence Quote
“this is an attempt with various neural Nets to reproduce a sign curve and after you know the region on the left it was it was trained for the region on the right is an extrapolation and it does horribly”
Source
Stephen Wolfram - Where the Computational Paradigm Leads (in Physics, Tech, AI, Biology, Math, ...)— Hertz FoundationCreated: 8/11/2026, 6:42:09 AM
Your notes
Loading notes...