definition
Grokking As Phase Shift In Understanding
Both AIs and humans undergo phase shifts from imitative to structural understanding: a human first imitates jazz sounds, then suddenly grasps the underlying structure and can improvise; in training this is called grokking, where loss slowly improves then suddenly the system develops a fundamentally different, more efficient way of doing things—and the worry is that such shifts break our current methods of keeping the system in check, predicting it, and ensuring it does what we want.
definitionpending
Speaker
Zvi MowshowitzEvidence Quote
“one of the worries is that this kind of shift breaks our current ways of keeping the system in check, of understanding the system, of predicting the system”
Created: 6/13/2026, 12:17:30 AM
Your notes
Loading notes...