forecast

Even good futures will be weird and possibly incomprehensible

Wanting AI integration to lead somewhere good is not a parochial imposition of current unreflective values—everyone interested in alignment endorses leaving room for reflection and moral progress—so even good futures will likely be quite weird, possibly even incomprehensible to us, yet there remains an important difference between a future genuinely expressive of our endorsed reflective values and one that has veered into something meaningless, even if we couldn't tell which from the inside.

forecastpending

Speaker

Joe Carlsmith

Evidence Quote

“we would not be very good at recognizing goodness or badness. I don't think that makes it insignificant though.”

Source

Joe Carlsmith — Preventing an AI takeover— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:01 AM

Your notes

Loading notes...