Neural networks fail at extrapolation: training a neural net to reproduce a sine curve in one region and then asking it to extrapolate beyond that region produces terrible results, even when the network size is increased.

factualpending

Speaker

Stephen Wolfram

Evidence Quote

“this is an attempt with various neural Nets to reproduce a sign curve and after you know the region on the left it was it was trained for the region on the right is an extrapolation and it does horribly”

Source

Stephen Wolfram - Where the Computational Paradigm Leads (in Physics, Tech, AI, Biology, Math, ...)— Hertz Foundation
Created: 8/11/2026, 6:42:09 AM

Your notes

Loading notes...