TPUs
Tensor Processing Units — Google's custom chips designed to accelerate machine learning workloads.
As defined in Sundar Pichai
Where it comes up · 2
- Sundar Pichai2 claims
- Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold1 claim
Most important claims · 3 of 3Search all claims for “TPUs” →
- As a leader you make many decisions but most day-to-day decisions are inconsequential and made just to keep things moving; effectiveness comes from identifying and getting right the few consequential decisions, made by hearing everyone out and then placing a clear bet, while tuning out noise and separating signal from noise.Sundar Pichai
- Google's decision to invest in TPUs ten years ago was a consequential strategic bet that positioned it to scale up and build big models, though even with TPUs the company had to ramp up manufacturing capacity over time to have enough compute.Sundar Pichai
- Scaling laws don't work by magic; at each new scale you must adjust hyperparameters and add innovations rather than repeat the same recipe, because extrapolating predictions several orders of magnitude can fail, capabilities can appear as step functions, and intermediate data points are needed to keep the scaling law true—making scaling an art form, with about one order of magnitude the maximum jump between eras.Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFold