factual

Brain efficiency advantage likely comes from massive parallelism

The brain's efficiency advantage over GPUs likely stems from being extremely parallel—doing perception, proprioception, and planning simultaneously—and since transformers are fundamentally parallelizable (made sequential only by position embeddings), an embodied system could run many attentional processes in parallel at different rates rather than one token at a time.

factualpending

Speaker

Sergey Levine

Evidence Quote

“Transformers aren't fundamentally sequential. You make them sequential by putting in position embeddings. Transformers are fundamentally very parallelizable things.”

Source

Fully autonomous robots are much closer than you think – Sergey Levine— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:29:18 AM

Your notes

Loading notes...