Preference Aggregation Knot
Definition
The fundamental unsolvable problem in RLHF that arises because reducing diverse human preferences (accuracy, style, voice) to single comparative values requires averaging—related to the Von Neumann-Morgenstern utility theorem and social choice theory—which flattens incisiveness and voice.
Cast within
No topic-region cast yet — this appears once Preference Aggregation Knot's compiled claims are aligned into a topic region's argument tree.
Claims mentioning Preference Aggregation Knot (1)
Your notes
Loading notes...