factual
Memory added by enlarging the state
A memoryless Markov chain can incorporate memory by enlarging the definition of a state—for example, running the chain on three-letter strings rather than single letters, where each step lops off the first letter and appends a new one—which underlies how language-prediction systems extend basic Markov models.
factualpending
Speaker
Jordan EllenbergEvidence Quote
“your next state is not T, it's HAT, because you're walking on the space of three-letter sequences and you're only allowed to lop off the first letter of your sequence and replace it with a new letter at the end.”
Created: 6/13/2026, 12:30:48 AM
Your notes
Loading notes...