Large language models are effective at interpolating (inferring patterns between known data points) but not at extrapolating (predicting beyond the training data), which means even if trained on physics first principles, they will fill in blind spots based on assumptions rather than true reasoning.
factualpending
Speaker
Dave BlondonEvidence Quote
“the LLMs that were using transformer-based are very good at interpolation, not quite as good at extrapolation. So it's going to fill in the blind spots between the training data that you give it and don't give it. I love the message of give it, you know, first principles physics, but I think everyone's going to do that.”
Source
The AI Reset Is Here: Search, Jobs, and Everything Else w/ Anish Acharya, Dave Blundin, Salim Ismail— Peter H. DiamandisCreated: 8/11/2026, 4:57:09 AM
Your notes
Loading notes...