← Back to feed

What are Diffusion Models?

L4 · DeveloperResearchLilian Weng's Blog· 7/11/2021

Essential technical resource for understanding the math and mechanisms behind modern image generation and diffusion-based AI systems.

AI Summary

Comprehensive technical deep-dive into diffusion models, covering foundational theory, classifier-free guidance, latent diffusion, and recent architectural advances. A frequently-updated reference guide that synthesizes key papers and techniques in generative modeling.

Excerpt

[Updated on 2021-09-19: Highly recommend this blog post on score-based generative modeling by Yang Song (author of several key papers in the references)]. [Updated on 2022-08-27: Added classifier-free guidance, GLIDE, unCLIP and Imagen. [Updated on 2022-08-31: Added latent diffusion model. [Updated on 2024-04-13: Added progressive distillation, consistency models, and the Model Architecture section.

Read Original
0 upvotes · 0 downvotes · 1 min read

Related Articles

L5 · ResearcherResearcharXiv
Mask-Aware Policy Gradients for Diffusion Language Models

Researchers introduce Mask-Aware Policy Gradients, a novel reinforcement learning approach for Masked Diffusion Language Models that optimizes both token placement and masking decisions during generation. This method achieves state-of-the-art results on mathematical reasoning (87.1% on GSM8K) and coding benchmarks (53.4% on MBPP) by addressing the intractable log-likelihood estimation problem in MDLMs. The paper formalizes MDLM generation as a two-stage action MDP and demonstrates significant performance improvements over existing approaches.

L4 · DeveloperResearch@emollick.bsky.social
Ethan Mollick (@emollick.bsky.social): This was one of those impressive AI thresholds for me. I gave GPT-5.6 Sol in Codex control over my computer, and asked it to win the daily challenge for the game Slay the Spire 2 (randomized factors,

In an experiment testing autonomous AI capabilities, the user gave a custom-tuned GPT model (GPT-5.6 Sol in Codex) direct control over their computer with the goal of winning the daily challenge in the complex roguelike game Slay the Spire 2. The AI successfully played the game autonomously for 5 hours, making complex strategic decisions to beat the randomized challenge. The result exemplifies a significant threshold in AI's ability to understand and execute multi-step objectives in a dynamic, unpredictable environment.

L5 · ResearcherResearch@AnthropicAI
Anthropic (@AnthropicAI): In previous research, we found that Claude expresses over 3,000 values, like honesty and warmth. In new work, we asked how the values Claude expresses vary between Claude models and across languages.

Anthropic researchers developed a methodology to analyze how Claude's expressed values vary across different model versions and languages, identifying four key axes that capture 15% of value variation including Deference vs. Caution and Warmth vs. Rigor. They found significant differences between Claude Opus 4.6 and 4.7 models, as well as between English and Arabic responses. This research provides quantitative insights into how training decisions and linguistic contexts shape AI assistant values and behavior.

L5 · ResearcherResearcharXiv
NIFA: Nonlinear IMC enhanced FPGA for efficient ML inference

This arXiv paper introduces a novel FPGA architecture called NIFA (Nonlinear IMC enhanced FPGA) that integrates ReRAM-based analog in-memory computing blocks with analog content-addressable memories to perform nonlinear operations directly within memory cells, overcoming limitations of conventional digital FPGAs for transformer model inference. The proposed hardware design eliminates power-hungry ADCs and enables more efficient attention computation, achieving up to 40× higher energy efficiency and 4.1× higher area efficiency for CNN/Transformer workloads. This represents foundational hardware architecture research for domain-specialized ML accelerators.

L5 · ResearcherResearcharXiv
BrainPilot: Automating Brain Discovery with Agentic Research

BrainPilot is a fully open-source multi-agent system that accelerates neuroscience research by orchestrating specialist agents grounded in domain-specific knowledge, with features like traceable logs, fabrication checking, and auditable workflows to ensure reliability. The system leverages a curated knowledge base of over 7,200 neuroscience items and a library of 72 reusable research skills across seven domains. Evaluated against neuroscience-specific benchmarks, it demonstrates performance comparable to state-of-the-art agent frameworks while being more cost-effective.