diffusion models
A class of generative AI models that create images by iteratively denoising random noise toward a target.
As defined in dwarkesh_mark_zuckerberg_llama_3_10b_models_caesar_augustus
Where it comes up · 4
- AI and Quantum Computing: Glimpsing the Near Future | World Science Festival2 claims
- Dwarkesh Patel Podcast - Grant Sanderson – AI and the future of math1 claim
- Martin Casado - Entering Uncharted AI Territory - [Invest Like the Best, EP.381]1 claim
- The Mastermind Behind GPT-4 and the Future of AI | Ilya Sutskever1 claim
Most important claims · 5 of 5Search all claims for “diffusion models” →
- For specialized physics problems, physicists are using diffusion models and other non-LLM techniques rather than large language models, indicating that the appropriate tools are problem-specific and that physicists are driving the computational approach rather than computer scientists retrofitting LLMs.AI and Quantum Computing: Glimpsing the Near Future | World Science Festival
- Diffusion models are more powerful than LLMs for physics applications because they add randomness in one direction and then iteratively remove it, which reveals underlying structure—this technique is also what generates realistic synthetic images and is being applied to solve partial differential equations without requiring exhaustive computation.AI and Quantum Computing: Glimpsing the Near Future | World Science Festival
- For getting AI to make cross-field connections, reasoning about the training data and environments is more productive than reasoning about architecture or loss function, because the environment determines what behavior gets incentivized.Dwarkesh Patel Podcast - Grant Sanderson – AI and the future of math
- Converting pixels or visual information into vector sequences is conceptually similar to treating sequences as 'language' in the abstract sense—both are sequential representations—and the distinction between sequential and parallel generation (as in diffusion models) is largely immaterial conceptually, though it may provide practical efficiency gains of around 10x.The Mastermind Behind GPT-4 and the Future of AI | Ilya Sutskever
- Ideogram was an obvious investment because its team, which included Google Imagen pioneers of diffusion models, built an image model that quickly reached very high quality.Martin Casado - Entering Uncharted AI Territory - [Invest Like the Best, EP.381]