Save this video free

UUtah CS 6340 NLP | Fall 2026 | Word embeddings (Part 2)

UofU Data Science · 59:42 · Watch on YouTube

Part of University of Utah CS 6340. See all 19 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

The lecture analyzes static word embeddings trained with skip-gram and negative sampling, comparing them with bag-of-words representations and explaining intrinsic and extrinsic evaluation, visualization, analogies, and encoded social biases. It then builds a binary sentiment classifier that averages token embeddings before an MLP, covering softmax predictions, gradient-based training, embedding fine-tuning, and classification metrics.

Key takeaways

Chapters

0:00 Static Word Embeddings Compared with Bag of Words
8:20 Embedding Limits: Word Sense and Word Order
8:30 Intrinsic and Extrinsic Evaluation of Embeddings
18:20 Visualizing Embedding Spaces with Dimensionality Reduction
20:20 Word2Vec Analogy Arithmetic and Its Limits
23:20 Gender and Race Biases in Word Embeddings
31:40 Bias Amplification Beyond the Training Data
36:40 Embedding Lookup and Average-Embedding Sentiment Inputs
45:40 Building an MLP Classifier with Logits and Softmax
50:25 Training, Fine-Tuning, and Evaluating the Classifier
53:55 Why Nonlinear MLP Layers Help Separate Sentiment Classes

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:00 Uh good afternoon everyone. Um hope you had a nice weekend. Uh yeah, it's been a while since I was teaching. How was the practical last time? I know some of you didn't have the best experience, but that's kind of to be expected. It's not the most chill of this at least. Um anything else you maybe want to share in this class setup? not not really in the class. Uh that's okay. Uh we are a little bit behind be uh with the grading mostly because of me because I'm still figuring out how to exactly grade it. But we'll try to uh be done with all of that soon. Uh but I don't know the exact date yet. I will

0:49 warn you if that uh changes. Um okay. So today we are going to continue where we left off. Uh and then once I'm done with everything I want to say about word embeddings, we are going to do a little quiz for 15 minutes and then we are going to see how much time we have left in the class, whether it makes sense to cover some more material or uh we just bounce and use the rest of our Monday. Any questions before I start? Okay, the room is big so I need to scan scan a wide space. All right. So, uh what we're going to chat now uh chat chat about now is uh the analysis of our word embeddings. We have used our skip gram. We have trained some word embeddings. Now, we have you know data structure which where for every word and

1:37 its index in the vocab. We have that embedding matrix where each row is the uh corresponding embedding of its corresponding word in the vocab. And we are going to just talk a little bit

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, UofU Data Science.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.