factual
Markers Disagree With Themselves
The core problem in traditional assessment is not disagreement between markers but disagreement within the same marker: in a study giving people 100 essays one week and 100 the next where six are secretly repeated, the same person gives the repeated essays different marks -- so the problem cannot be solved by hierarchy or an expert, because the expert will disagree with themselves.
factualpending
Speaker
Daisy ChristodoulouEvidence Quote
“the issue is not disagreement between human beings, the issue is disagreement within the same human being, and that is not going to be resolved by hierarchy because that expert will disagree with themselves.”
Source
Coase, the Rules of the Game, and the Costs of Perfection (with Daisy Christodoulou)— EconTalkCreated: 6/13/2026, 12:10:59 AM
Your notes
Loading notes...