causal

Pre-Training Lacks Novel Discovery Skill

The pre-training objective gives models flexible general knowledge but does not imbue the skill of making novel connections or doing research; significant RL on research-like tasks is likely needed before models can approach making novel scientific discoveries.

causalpending

Speaker

Sholto Douglas

Evidence Quote

“I think at a minimum you need significant RL in at least similar things to be able to approach making novel discoveries.”

Source

AMA: career advice given AGI, how I research ft. Sholto & Trenton— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:36:46 AM

Your notes

Loading notes...