causal
Filling the full context window has costs
Even with long-context models, filling the entire context window makes inference slower and can confuse the model — and some models get more confused than others — so deciding what to include in a limited prompt space is a real design problem.
causalpending
Speaker
Arvid LunnemarkEvidence Quote
“filling out the entire context window means that it’s slower. It means that sometimes the model actually gets confused”
Created: 6/13/2026, 3:31:02 AM
Your notes
Loading notes...