factual

Markers Disagree With Themselves

The core problem in traditional assessment is not disagreement between markers but disagreement within the same marker: in a study giving people 100 essays one week and 100 the next where six are secretly repeated, the same person gives the repeated essays different marks -- so the problem cannot be solved by hierarchy or an expert, because the expert will disagree with themselves.

factualpending

Speaker

Daisy Christodoulou

Evidence Quote

“the issue is not disagreement between human beings, the issue is disagreement within the same human being, and that is not going to be resolved by hierarchy because that expert will disagree with themselves.”

Source

Coase, the Rules of the Game, and the Costs of Perfection (with Daisy Christodoulou)— EconTalk
Created: 6/13/2026, 12:10:59 AM

Your notes

Loading notes...