normative
Autonomy algorithms optimize value-laden cost functions
Every time you drive you make tradeoffs—e.g., turning the risk knob up when late or down when carrying kids—and so does every autonomy algorithm, which works by optimizing cost functions balancing factors like fuel efficiency versus performance that are often in conflict; therefore systems should be designed so the user has transparent input into those value-laden decisions, so the car drives according to your values and priorities rather than a programmer's hidden choices.
normativepending
Speaker
David MindellEvidence Quote
“those decisions are going to get made somewhere, either by a programmer back in a cubicle somewhere or are they going to be made transparently in a way that a user can have input into them, so that the car drives according to your values”
Created: 6/13/2026, 3:19:57 AM
Your notes
Loading notes...