Save this video free

UUtah CS 6340 NLP | Fall 2026 | Intro to vector semantics

UofU Data Science · 18:49 · Watch on YouTube

Part of University of Utah CS 6340. See all 19 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

The lecture explains why NLP systems need numerical representations that capture relationships in meaning, not just token identity. It contrasts one-hot and bag-of-words vectors, which can be sparse and fail to encode semantic similarity, with dense token embeddings; it previews Word2Vec and notes that modern LLM token embeddings use related intuition but are not identical.

Key takeaways

Chapters

0:00 From BPE Tokenization to Meaningful Numerical Representations
4:40 One-Hot and Bag-of-Words Vectors: Sparse, Meaning-Blind Encodings
13:00 Why Dense Word Embeddings Improve Semantic Representation

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:02 You plug in the dollar. >> Oh, no. Like, >> okay. Um, welcome back. How was that? Fine. Yeah, enough time. I think that was enough time. We all done it before uh before the end. Uh, good. Okay. So, that's roughly what you can expect from all the quizzes. When we have more content to cover it, they are probably going to be a little bit longer. we are going to adjust the time and yeah if you have any concerns send them my way uh happy to hear if something doesn't work out in this format. Um okay um I hear also maybe some of you are discussing also the uh the quiz which was the online quiz in uh canvas for checking your background. Um I don't have the

0:49 solutions handy uh just to hand them out. So yeah, I'll stick around after the lecture. If you have any questions about those, just just ask me and I'm happy to explain the answers and tell you what the right answers are. Okay. Uh moving on with uh our topics. So um this is yet another visualization of you know um prompting uh CHPT and kind of seeing what's happening after that. Uh so again you're seeing this prompt explain some superconductors like I'm five years old and now you know that there is this tokenizer which involves both the vocabulary of possible tokens and uh the segment or encoder part of the tokenizer

1:37 which has with at least with the case of BP these rules uh which are basically greedily apply these merges uh to this new piece of text. Um, and then you get tokenize text. And important thing to remember, something that I didn't quite visualize or maybe stress enough is that vocabulary is a dictionary where each

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, UofU Data Science.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.