definition

How Gradient Descent Trains an AI

Training begins with enormous compute and data; the AI starts predicting text randomly, and gradient descent tunes up the billions of internal parameters that contributed to correct predictions and tunes down those contributing to wrong ones, repeated over vast data for huge time - so humans understand the tuning process but not the resulting trillions of meaningless numbers.

definitionpending

Speaker

Nate Soares

Evidence Quote

“humans understand the little automated process that like looks through the ai's mind and calculates which which part of this process contributed towards the right answer versus towards the wrong answer they don't understand what comes out at the end”

Source

434 - Can We Survive Ai— Making Sense with Sam Harris
Created: 6/14/2026, 2:10:11 AM

Your notes

Loading notes...