causal
Good synthetic data requires verified reasoning
The best synthetic data is data that required a lot of reasoning to create and whose reasoning can be verified—which is why DeepMind's geometry work succeeded: geometry is easily formalizable and verifiable, so you can generate heaps of verified proofs and train on them as known-good data, with the real world serving as verifier in other domains.
causalpending
Speaker
Sholto DouglasEvidence Quote
“what I imagine as good data is data where it had to do reasoning to produce something. And then the trick of course is how do you verify that that reasoning was correct?”
Created: 6/13/2026, 3:31:11 AM
Your notes
Loading notes...