factual

Humans excel at comparative over absolute judgment

Humans are much better at comparative judgment (choosing which of two essays is better) than at absolute judgment (placing one essay on a mark scheme); collecting hundreds of thousands of such pairwise judgments and combining them algorithmically creates a reliable measurement scale, and human comparative judgment is the gold standard used to train LLMs.

factualpending

Speaker

Daisy Christodoulou

Evidence Quote

“you look at two, you say which is better, you collect hundreds of thousands of judgments like that... You can use the algorithm to combine them all, create the measurement scale”

Source

How Better Feedback Can Revolutionize Education (with Daisy Christodoulou)— EconTalk
Created: 6/13/2026, 12:13:24 AM

Your notes

Loading notes...