causal
Byrnes' answer to how genome encodes high-level desires
Steve Byrnes proposes a solution to Ilya Sutskever's question of how evolution encodes high-level desires: a Steering Subsystem with innate reward functions and primitive sensors (e.g. superior colliculus detecting faces/threats) trains predictors ('Thought Assessors') in the cortex/amygdala that learn which abstract world-model neurons predict innate responses, thereby robustly wiring learned features to innate rewards.
causalpending
Speaker
Adam MarblestoneEvidence Quote
“What are the neurons that matter in the cortex for social status or for friendship? They're the ones that predict those innate heuristics for friendship. You train a predictor in the cortex and you say, "Which neurons are part of the predictor?" Those are the ones that, now you've actually managed to wire it up.”
Source
Adam Marblestone – AI is missing something fundamental about the brain— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:32:22 AM
Your notes
Loading notes...