causal

Brain's secret sauce is loss functions not architecture

The AI field has neglected the role of very specific loss and cost functions; whereas machine learning prefers mathematically simple loss functions (next-token prediction, cross-entropy), evolution built enormous complexity into many different loss functions, turned on at different developmental stages, effectively a curriculum encoded as 'Python code' for what each brain region must learn.

causalpending

Speaker

Adam Marblestone

Evidence Quote

“I think evolution may have built a lot of complexity into the loss functions actually, many different loss functions for different areas turned on at different stages of development. A lot of Python code, basically, generating a specific curriculum for what different parts of the brain need to learn.”

Source

Adam Marblestone – AI is missing something fundamental about the brain— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:32:22 AM

Your notes

Loading notes...