definition

Grokking As Phase Shift In Understanding

Both AIs and humans undergo phase shifts from imitative to structural understanding: a human first imitates jazz sounds, then suddenly grasps the underlying structure and can improvise; in training this is called grokking, where loss slowly improves then suddenly the system develops a fundamentally different, more efficient way of doing things—and the worry is that such shifts break our current methods of keeping the system in check, predicting it, and ensuring it does what we want.

definitionpending

Speaker

Zvi Mowshowitz

Evidence Quote

“one of the worries is that this kind of shift breaks our current ways of keeping the system in check, of understanding the system, of predicting the system”

Source

Zvi Mowshowitz on AI and the Dial of Progress— EconTalk
Created: 6/13/2026, 12:17:30 AM

Your notes

Loading notes...