definition
RLHF as alternative when taste defies rubrics
When taste cannot be captured in a rubric—as Kant argued—an alternative is RLHF: have the model generate two responses, have people with taste choose which they prefer, and repeat many times until the model understands their preferences.
definitionpending
Speaker
Brendan FoodyEvidence Quote
“Another kind isRLHF... have these people with a lot of taste choose which response they prefer, and do that many times until the model is able to understand their preferences”
Created: 6/12/2026, 4:53:54 PM
Your notes
Loading notes...