Save this video free

Lecture 2: Probability Background (KAIST AIC313/CS378, Fall 2026)

Minhyuk Sung · 1:08:06 · Watch on YouTube

Part of KAIST AIC313/CS378. See all 12 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

Minhyuk Sung reviews the probability and statistics foundations used throughout KAIST AIC313/CS378, including random variables, probability distributions, Bayes' rule, and likelihood. He connects these tools to generative modeling through maximum-likelihood estimation for categorical and Gaussian data, then motivates autoregressive models by showing why sequence distributions become too large to model directly.

Key takeaways

Chapters

0:00 Why Generative Modeling Starts with Probability
2:39 Random Variables, PMFs, and PDFs
10:18 Expectations, Variance, and the Allais Paradox
15:21 Generative Modeling and Joint Distributions
21:01 Conditional Distributions from Joint and Marginal Probabilities
24:34 Bayes' Rule: Prior, Likelihood, Evidence, and Posterior
31:17 Independence and Conditional Independence
36:32 Categorical and Multivariate Gaussian Distributions
43:13 Likelihood and Maximum-Likelihood Estimation
51:06 Categorical Maximum Likelihood from Class Counts
55:46 Gaussian Maximum-Likelihood Estimates
1:01:07 Why Simple Distributions Cannot Model Real Data
1:05:15 Probability Review and Next-Lecture Preview

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:03 Okay. So, welcome to the second uh lecture of the uh introduction to the model modeling. So today um we are going to have some kind of review of the background of the probability and the statistics and how uh some of the other people who took the machine learning course or the deep learning course was there some kind of the some those kind of the review of the some background of the probably in the statistics. Yes. Anyone who took the introduction to machine learning course or introduction to AI was there any kind of some review for the probably the statistics? Yes. Yeah. Then there might be lots of some overlap in terms of dealing with those kind of things. Actually the reason like why we want to cover those kind of the

0:51 basic things is that actually not only uh for the generative modeling but for the many aspects in the machine learning like everything is basically based on the probability and also the statistics. So as we also discussed last time uh basically what we want to do with the uh in the general modeling is that we want to basically learn kind of the distribution of the the data right so that's basically the case that we only have some kind of the samples which are basically our training data which are coming from some kind of underlying distribution that we want to know which is basically not known. Uh so our goal in this modeling is to learn that distribution uh in a way that the we can see that some kind of the the samples that are basically given as kind of

1:38 training data are basically compatible with the basically our model for that distribution. So we're going to keep uh you know discussing those kind of the

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, Minhyuk Sung.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.