causal

Good synthetic data requires verified reasoning

The best synthetic data is data that required a lot of reasoning to create and whose reasoning can be verified—which is why DeepMind's geometry work succeeded: geometry is easily formalizable and verifiable, so you can generate heaps of verified proofs and train on them as known-good data, with the real world serving as verifier in other domains.

causalpending

Speaker

Sholto Douglas

Evidence Quote

“what I imagine as good data is data where it had to do reasoning to produce something. And then the trick of course is how do you verify that that reasoning was correct?”

Source

Sholto Douglas & Trenton Bricken — How LLMs actually think— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:31:11 AM

Your notes

Loading notes...