definition
How Gradient Descent Trains an AI
Training begins with enormous compute and data; the AI starts predicting text randomly, and gradient descent tunes up the billions of internal parameters that contributed to correct predictions and tunes down those contributing to wrong ones, repeated over vast data for huge time - so humans understand the tuning process but not the resulting trillions of meaningless numbers.
definitionpending
Speaker
Nate SoaresEvidence Quote
“humans understand the little automated process that like looks through the ai's mind and calculates which which part of this process contributed towards the right answer versus towards the wrong answer they don't understand what comes out at the end”
Created: 6/14/2026, 2:10:11 AM
Your notes
Loading notes...