causal
Brain's secret sauce is loss functions not architecture
The AI field has neglected the role of very specific loss and cost functions; whereas machine learning prefers mathematically simple loss functions (next-token prediction, cross-entropy), evolution built enormous complexity into many different loss functions, turned on at different developmental stages, effectively a curriculum encoded as 'Python code' for what each brain region must learn.
causalpending
Speaker
Adam MarblestoneEvidence Quote
“I think evolution may have built a lot of complexity into the loss functions actually, many different loss functions for different areas turned on at different stages of development. A lot of Python code, basically, generating a specific curriculum for what different parts of the brain need to learn.”
Source
Adam Marblestone – AI is missing something fundamental about the brain— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:32:22 AM
Your notes
Loading notes...