factual

Why an AI Would Have a Utility Function

A superintelligence need not have human-like emotions, but the agent framework is general: an intelligent system has something like a utility function—a criterion for choosing actions—because we would build it that way to achieve predictability, since a utility function is an inspectable place to look to see what the system will tend to do, whereas a system without one is intelligent but unpredictable.

factualpending

Speaker

Nick Bostrom

Evidence Quote

“We would put it in.”

Source

Nick Bostrom on Superintelligence— EconTalk
Created: 6/13/2026, 12:04:17 AM

Your notes

Loading notes...