definition

RLHF as alternative when taste defies rubrics

When taste cannot be captured in a rubric—as Kant argued—an alternative is RLHF: have the model generate two responses, have people with taste choose which they prefer, and repeat many times until the model understands their preferences.

definitionpending

Speaker

Brendan Foody

Evidence Quote

“Another kind isRLHF... have these people with a lot of taste choose which response they prefer, and do that many times until the model is able to understand their preferences”

Source

Brendan Foody— Conversations with Tyler
Created: 6/12/2026, 4:53:54 PM

Your notes

Loading notes...