factual

Comparative Judgment Yields Absolute Standard at Scale

Comparative judgment is not mere rank-ordering; by linking large crowd-sourced assessments over time (e.g., 50,000 pieces of writing judged by thousands of teachers, each session linked to the last) it builds a robust distribution on which you can draw a line wherever your standards dictate, and it is especially good at holding that line consistently over time -- one of the hardest things to achieve in assessment.

factualpending

Speaker

Daisy Christodoulou

Evidence Quote

“we link all of our assessments over time... we've now got this giant scale, that's effectively representing the scores of all the students who have taken part... and then you can decide where you want to draw the line.”

Source

Coase, the Rules of the Game, and the Costs of Perfection (with Daisy Christodoulou)— EconTalk
Created: 6/13/2026, 12:10:59 AM

Your notes

Loading notes...