Save this video free

EfficientML.ai Lecture 17 - Diffusion Model (Part I) (MIT 6.5940 Fall 2026)

MIT HAN Lab · 1:06:10 · Watch on YouTube

Part of Massachusetts Institute of Technology 6.5940 EfficientML.ai. See all 19 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

The lecture develops diffusion models from their Gaussian noising and denoising process through classifier-free guidance and latent diffusion, then shows how Deep Compression Autoencoders (DCAE) and linear attention reduce generation cost. It connects these techniques to Sana image and video generation, Sana World Model, ForeAct robot planning, and LongLive streaming video, citing results such as up to 106× image-generation acceleration and LongLive 2.0 rates above 45 frames per second.

Key takeaways

Chapters

0:00 Generative Models and the Diffusion Model Roadmap
5:05 DDPM Forward Diffusion and the Closed-Form Noise Kernel
11:38 Learning Reverse Denoising with Noise-Prediction Loss
14:45 Classifier Guidance and Classifier-Free Guidance
22:02 Latent Diffusion Moves Denoising Out of Pixel Space
26:50 DCAE Cuts Diffusion Tokens with 64× Spatial Compression
29:56 DCAE Training: Residual Paths, Resolution Adaptation, and DCAE 1.5
36:59 Sana Replaces Quadratic Softmax Attention with Linear Attention
43:04 Sana Image Generation: Prompt Expansion and Reported Speedups
46:33 Sana Video and Sana World Model for Long, Controllable Clips
54:12 ForeAct Uses Generated Images to Guide Robot Planning
56:19 LongLive Enables Interactive, Frame-Level Video Generation
1:00:37 LongLive 2.0 Adds FP4 Efficiency and Multi-Shot Streaming

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:01 Uh okay, good afternoon everyone. Uh today we are going to talk about the lecture 17 uh diffusion model. Uh this is uh first part of the our lecture on uh diffusion model and on Thursday we will have the uh second half uh about the course content on the topic. So today we will have very detailed discussion of the definition of diffusion model, how is it built and some applications and optimizations regarding to this kind of powerful model for multi-modal generation, image generation and video generation. Uh so first of all let's begin with

0:50 some backgrounds of generative learning or we will talk about the basics between basically distinctions between discriminative and generative learning. So a discriminative model learns decision boundary or conditional prediction. For example we have talked about some tasks such as image classification, object detection, such kind of things and all these are [snorts] uh discriminative discriminative learning, discriminative models and generative model can be something different. It tries to learn the underlying data distribution so that we can sample from sample some new examples from the original distribution.

1:38 Specifically we can use generative model to output some for example image data, video data as shown in this example. So we have data distribution here and we train the model and we use the model to do some inference, do some sampling so we can get some examples from the original original for example image distribution, so we can get a cats here. So that is from the original distribution different kinds of cats. And here is a more detailed definition of these two kind of models, the discriminative ones and the generative ones. So as we have talked the discriminative models for tasks such

2:26 as classification and object detection etc. And the generative models ports image

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, MIT HAN Lab.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.