Save this video free

ECE 1786 Lecture 1 September 8, 2026

Jonathan Rose · 1:33:52 · Watch on YouTube

Part of University of Toronto ECE 1786. See all 10 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

Jonathan Rose introduces ECE 1786’s three goals: understand how large language models and transformers work, learn to build applications with them, and practice turning ideas into clear engineering projects. The first technical lecture explains why rule-based natural language processing struggles, then uses word embeddings, GloVe vectors, Euclidean distance, cosine similarity, and vector arithmetic to explore meaning, analogy, bias, and interpretability. Assignment 1 applies these ideas; students may not use generative AI to write its code, while AI use is encouraged for the course project.

Key takeaways

Chapters

0:00 ECE 1786 Goals, Course Structure, and Assignment 1 Rules
8:19 Why Natural Language Processing Is Called Natural
10:40 Polysemy: Why the Word Bank Needs Context
13:40 Paraphrases, Headlines, and Hidden Context
18:00 From Hand-Written Rules to Numerical Representations
22:01 From Co-Occurrence Counts to Neural Word Embeddings
25:00 Word Embeddings, Vocabulary Tables, and Euclidean Distance
32:03 High-Dimensional Meaning and the GloVe Notebook
37:01 Inspecting GloVe Vectors and Meaning by Context
45:10 Cosine Similarity and Context-Dependent Word Senses
52:11 Nearest-Word Search as a Lens into Embedding Space
56:37 Vector Arithmetic: King, Queen, and Relational Analogies
1:02:03 Embedding Bias and Three-Dimensional PCA Exploration
1:06:50 Dot Products and Linear Relationships in Word Vectors
1:12:27 How Word2Vec Training Produces Meaningful Vectors
1:19:00 Interpretable Dimensions from Color and Other Concepts
1:26:45 Averaging, Sentence Classification, and the Linearity Hypothesis
1:28:42 Assignment 1 Setup and Installing Tools with UV

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:03 All right, good morning everyone and welcome to ECE 1786 lecture number one. You hopefully have seen lecture number zero. I've sent out messages on that. If you're not registered in the course, you can see everything pretty much everything that's on the main course website on this public website. If you Google ECE 1786, you usually end up in the 2025 site, but uh there is one with 2026 as well. Um So, uh make sure if you haven't, you you've gone and watched lecture zero because it describes the entire structure of this course and I'm not going to not going to really repeat that and there's a bunch of moving pieces to the course. And uh I ask you to also carefully consider if you have the right technical background for this course because the assignments require it and uh

0:52 yeah, it's the we have we don't actually have a way to enforce prerequisites in graduate school here. So, we So, uh I used to just tell look ask people to tell me about their background and kick them out if they didn't have it. Now, I let you decide for yourself mainly after finishing the last two sections of assignment one, you can you can go well, no, actually I don't know any of this. I better I better go take the courses that uh that uh teach the background material. Um I will recap lecture zero. I want to say a few things about uh the core the core items there. First of all, this course is about three things. The first thing is to teach you the inner inner workings of large language models, transformers, and how they're trained

1:40 and how they're structured. And so, to have some fundamental understanding of this thing that is revolutionizing

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, Jonathan Rose.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.