Symbolic AI researchers rejected Hinton's predictive word-vector approach as a 'silly way' to solve language problems, arguing that searching discrete symbol-manipulation rules was superior, but as the scale of problems increased, the feature-interaction approach proved vastly more scalable and effective than symbolic rule-based methods

causalpending

Speaker

Geoffrey Hinton

Evidence Quote

“as things scaled up it became very clear that that approach of converting symbol strings into features and their interactions which still describes the language models now the interactions are more sophisticated because they involve attention um but it's in the same class of models that turns out to be a much better way to model language than having rules for manipulating simple strings”

Source

Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024— Vector Institute
Created: 8/11/2026, 7:34:33 AM

Your notes

Loading notes...