Save this video free

Lecture 9e

Prof. Schniter · 56:11 · Watch on YouTube

Part of The Ohio State University ECE 5307. See all 30 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

Prof. Schniter traces language models from GPT-1's 117 million parameters and BERT's masked-word training through GPT-3's 175 billion parameters, multimodal systems, reasoning models, and AI agents. The central lesson is that progress has come from scaling data and compute as well as refining training: pretraining is followed by supervised fine-tuning and reinforcement learning, with verifiable rewards especially effective for math and code. The lecture also demonstrates zero-shot classification and text embeddings using scikit-llm and dimensionality reduction.

Key takeaways

Chapters

0:00 GPT-1 and BERT Introduce Different Pretraining Objectives
3:48 GPT-2 and GPT-3 Scale Transformers into ChatGPT
11:29 GPT-3 Parameter Allocation, GPT-4, and Reasoning Models
17:51 Open-Weight Models: Llama, DeepSeek-R1, and Efficient Transformers
22:17 AI Agents Plan, Act, and Use External Tools
24:35 Pretraining, Supervised Fine-Tuning, and Hallucination Control
31:12 Chain-of-Thought Reasoning and the Swiss-Cheese Problem
35:28 Reinforcement Learning: Actions, Rewards, and Long-Term Goals
38:49 Verifiable Rewards, Human Feedback, and Superhuman Systems
45:49 Zero-Shot Classification with scikit-llm
52:15 Text Embeddings and PCA Reveal Semantic Relationships

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:02 All right, welcome back, everyone. Hope you had a good weekend. Um so what we're going to do today is we're going to move um chronologically through a number of the famous um large language models, um focusing on OpenAI because they were sort of there uh from the beginning. And um yeah, so we'll I guess we started with this Transformer paper last time. Um but let's focus on GPT-1. So [snorts] what's special about GPT-1 is that it this was the first model that proposed to pre-train on next token prediction, which is what we sort of focused on for most of this unit. [snorts] Um and then fine-tune on a desired target task. We haven't really talked much about that, um but maybe

0:50 we'll get into that later today. And um just wanted to pay attention to a few of the numbers here and see how they change over time. So uh this model used this byte pair encoding tokenization with 50,000 tokens. Um it had 10 or sorry, 12 Transformer blocks, 12 attention heads per block. The embedding dimension was 768. The context [snorts] length 512 and 117 million parameters. Uh pre-training was done on this book corpus dataset, 7,000 unpublished fiction books, about a billion words, taking one petaflops per second days and costing

1:38 about $50,000 at the time. Um just to show you that this is sort of not the only thing that works, pre-training on next token prediction, um Google uh very similar time, so this is June 2018, Google and October 2018 proposed this BERT model. Um so instead of pre-train next token prediction, [snorts] BERT pre-trained to number one, predict a random masked word in the sentence and predict whether one sentence follows another or not. [clears throat] And so once they

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, Prof. Schniter.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.