factual

Training Inscrutable Arrays Resembles Natural Selection

Taking a giant inscrutable array of floating point numbers and differentiating it against a loss function to drive the loss lower is analogous to natural selection rather than to writing code you understand: you blindly explore a space of possibilities and make things that solve the problem without understanding how, which is Step One toward creating things with strange inscrutable desires.

factualpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“This itself is not enough to create things with strange, inscrutable desires, but it's Step One.”

Source

Eliezer Yudkowsky on the Dangers of AI— EconTalk
Created: 6/13/2026, 12:26:27 AM

Your notes

Loading notes...