Knowledge can be transferred between analog neural systems through distillation (having the system learn to match the outputs of a teacher system), which is how humans transfer knowledge—teachers speak and students adjust their weights to reproduce what the teacher said.
factualpending
Speaker
Geoffrey HintonEvidence Quote
“the way we get Knowledge from one of our brains to another of our brains is you say stuff the teacher says stuff and the student tries to figure out how to change the weights in their brain so that they would have said the same stuff um that's called distillation”
Source
Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024— Vector InstituteCreated: 8/11/2026, 6:32:35 AM
Your notes
Loading notes...