Preference Aggregation Knot

Definition

The fundamental unsolvable problem in RLHF that arises because reducing diverse human preferences (accuracy, style, voice) to single comparative values requires averaging—related to the Von Neumann-Morgenstern utility theorem and social choice theory—which flattens incisiveness and voice.

Cast within

No topic-region cast yet — this appears once Preference Aggregation Knot's compiled claims are aligned into a topic region's argument tree.

Claims mentioning Preference Aggregation Knot (1)

Your notes

Loading notes...