The hope 20 years ago was that we could understand what we were trying to train AI systems to do before they became capable, but 'now it's kind of late'—capabilities have advanced to the point where we no longer have time for deep foundational understanding.