Symbolic AI researchers rejected Hinton's predictive word-vector approach as a 'silly way' to solve language problems, arguing that searching discrete symbol-manipulation rules was superior, but as the scale of problems increased, the feature-interaction approach proved vastly more scalable and effective than symbolic rule-based methods
causalpending
Speaker
Geoffrey HintonEvidence Quote
“as things scaled up it became very clear that that approach of converting symbol strings into features and their interactions which still describes the language models now the interactions are more sophisticated because they involve attention um but it's in the same class of models that turns out to be a much better way to model language than having rules for manipulating simple strings”
Source
Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024— Vector InstituteCreated: 8/11/2026, 7:34:33 AM
Your notes
Loading notes...