factual
Humans excel at comparative over absolute judgment
Humans are much better at comparative judgment (choosing which of two essays is better) than at absolute judgment (placing one essay on a mark scheme); collecting hundreds of thousands of such pairwise judgments and combining them algorithmically creates a reliable measurement scale, and human comparative judgment is the gold standard used to train LLMs.
factualpending
Speaker
Daisy ChristodoulouEvidence Quote
“you look at two, you say which is better, you collect hundreds of thousands of judgments like that... You can use the algorithm to combine them all, create the measurement scale”
Created: 6/13/2026, 12:13:24 AM
Your notes
Loading notes...