Save this video free

CMU Introduction To Deep Learning 11-785, Fall 2026: Lecture 21

Carnegie Mellon University Deep Learning · 1:26:54 · Watch on YouTube

Part of Carnegie Mellon University 11-785 Introduction to Deep Learning. See all 24 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

The lecture explains neural-network classification as statistical estimation: cross-entropy training performs maximum-likelihood learning of class probabilities, while hidden layers transform inputs into features a final linear classifier can separate. It then interprets perceptron weights as learned pattern templates and connects autoencoders to PCA, nonlinear data manifolds, and source-specific decoders for generating and separating signals.

Key takeaways

Chapters

0:00 Pre-Class Conversation and Classroom Setup
5:47 Lecture 21: What Neural Networks Learn Internally
9:03 Noisy Labels Call for Probabilistic Classification
11:54 Local Label Frequencies Motivate the Sigmoid
14:54 Sigmoid Outputs as Posterior Probabilities
20:57 Cross-Entropy Training Is Maximum-Likelihood Estimation
29:00 Hidden Layers Make Nonlinear Inputs Linearly Separable
35:38 Classification Networks as Feature Extractors Plus a Classifier
43:12 How Training Progressively Separates Classes
45:00 A Circle Classifier Warps a 2D Sheet into a Threshold
55:22 CIFAR-10 Layers Separate Classes in PCA Visualizations
1:01:20 Perceptron Weights Act as Pattern Templates
1:07:00 Learned Features Reveal What an Input Contains
1:10:40 Linear Autoencoders Recover Principal Components
1:15:35 Nonlinear Decoders Learn Principal Manifolds
1:18:59 Spirals and Sinusoids Show Manifold Reconstruction
1:20:39 Source-Specific Decoders Generate and Separate Signals

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:11 Okay. Yes. Let's go and study after this class. I'm just watching.

1:00 >> Look at him. >> I always make I have a deadline for something. >> [laughter] >> Oh,

1:48 no. >> KBKI. This is what exactly is current and so it's talking about >> I haven't seen this math. So on Friday at 2:00 we had a recession on different subject and after this this class was there and he was also master student and he was amazing at teaching like he was actually he was just so good. I got to learn from the end of the day. [snorts]

2:50 Okay. Give it to me. Happy. Sit down. [clears throat] >> That's good. >> Two days. What do you mean like Okay. >> Yeah. That's a good idea. >> Morning.

3:51 >> There's nothing deep about today's class. I'm just calling it neural networks. Haven't we done this? >> Good morning, professor. How are you? >> Good to see you, too. >> You're supposed to come here. >> I'm not going all the way back. >> See, [laughter] you can't say no. >> My kids and [laughter] Morning Lucas. That's cold.

4:57 Freezing. I was like, my hands are numb. But I walk. >> It's not cold. >> I'm I'm a weenie. >> We got another 20° to go south. >> I know. I got more layers to putus. >> Like two Januaries ago, it went to minus 40 with wind near our home. Our home fell apart. It cost us almost a quart million to fix it. >> - 40 is brutal. >> 24 radiators burst in our house. >> Think you're replaced with radiators, too? >> Like we couldn't because it's a 100-y old house. >> Yeah. >> So, large portions of our house are not heated right now.

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, Carnegie Mellon University Deep Learning.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.