causal

Byrnes' answer to how genome encodes high-level desires

Steve Byrnes proposes a solution to Ilya Sutskever's question of how evolution encodes high-level desires: a Steering Subsystem with innate reward functions and primitive sensors (e.g. superior colliculus detecting faces/threats) trains predictors ('Thought Assessors') in the cortex/amygdala that learn which abstract world-model neurons predict innate responses, thereby robustly wiring learned features to innate rewards.

causalpending

Speaker

Adam Marblestone

Evidence Quote

“What are the neurons that matter in the cortex for social status or for friendship? They're the ones that predict those innate heuristics for friendship. You train a predictor in the cortex and you say, "Which neurons are part of the predictor?" Those are the ones that, now you've actually managed to wire it up.”

Source

Adam Marblestone – AI is missing something fundamental about the brain— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:32:22 AM

Your notes

Loading notes...