causal
Grading order biases essay scores
Grading subjective essay answers is susceptible to streakiness: after a run of bad papers a merely decent paper reads as a breath of fresh air and gets over-rewarded, while after two or three A+ papers what would be an A reads as a B+, so the order of papers introduces an arbitrary, unjust subjectivity.
causalpending
Speaker
Russ RobertsEvidence Quote
“I think streakiness does affect judges, inevitably, as human beings.”
Created: 6/13/2026, 12:10:38 AM
Your notes
Loading notes...