forecast
Even good futures will be weird and possibly incomprehensible
Wanting AI integration to lead somewhere good is not a parochial imposition of current unreflective values—everyone interested in alignment endorses leaving room for reflection and moral progress—so even good futures will likely be quite weird, possibly even incomprehensible to us, yet there remains an important difference between a future genuinely expressive of our endorsed reflective values and one that has veered into something meaningless, even if we couldn't tell which from the inside.
forecastpending
Speaker
Joe CarlsmithEvidence Quote
“we would not be very good at recognizing goodness or badness. I don't think that makes it insignificant though.”
Created: 6/13/2026, 3:37:01 AM
Your notes
Loading notes...