Five years ago, discussion of AI systems deceiving humans to accomplish goals would have been laughed out of the room; the field was unprepared for AI capabilities to reach this level, which explains current unpreparedness for further capability scaling.