Save this video free

CMU AI Agents 2026: 1. What are Agents and How Do They Work?

Graham Neubig · 1:07:53 · Watch on YouTube

Part of Carnegie Mellon University 11-768. See all 14 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

Daniel Fried and Graham Neubig introduce AI agents as systems that perceive an environment, act through tools, and use feedback to make progress, then explain how a ReAct-style loop connects language models to real tasks. They frame agent quality around tool accuracy, long-context coherence, task management, environment understanding, customization, and safety, showing how both model training and harness engineering contribute; the lecture also outlines CMU's assignments, research project, and course policies.

Key takeaways

Chapters

0:00 Agent Successes, Failures, and Where Users Draw the Line
7:15 Browser and Coding Agent Demos at CMU
15:22 Russell and Norvig's Agent Definition: Perception, Action, and Reward
19:24 How Tool Schemas Turn Language Models into Environment-Using Agents
24:25 The ReAct Loop: Reason, Call Tools, Observe, Repeat
30:17 SWE-bench Trajectories and the mini-swe-agent Pattern
35:35 Six Capabilities Behind Reliable Agents
42:00 Model Training Versus Harness Engineering
49:38 Practical Methods for Context, Planning, and Environment Understanding
51:49 Safety Failures: Sandboxing, Credentials, and Monitoring
58:45 Agents as Systems: Harnesses, Sandboxes, Inference, and Monitoring
1:01:39 Course Outcomes, Assignments, and Research Projects
1:04:41 Prerequisites, AI Use, Grading, and Late Policies

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:00 Okay. Um, hi everyone. Welcome to 11768, uh, AI agents. We're very excited to be teaching this new course, uh, which is timely as, uh, a lot of people are starting to use agents. Um, my name is Graham Nubig. I'm an associate professor in the school of computer science here. I've been working on agents for maybe uh, several years now. Uh, coding agents, web browsing agents, uh, those sorts of things. and I'll be co-eing together with Daniel who will be kicking off this class. So without further ado, I'll turn it over to him and he can start uh this and I'll I'll do the second part of the class. >> Thanks Graeme. How's this? Cool. Yeah. So um hi everyone. Really

0:48 excited that you're here. My name is Daniel Freed. Um my research group also works on agents. Um so uh grounded agents and also interaction between people and agents and these days interaction between agent systems. So uh excited to talk about um all these topics with you and um yeah we have a really great core staff too who we will introduce in in a few slides. But yeah so agents are are really timely right now and um the capabilities of agents are advancing pretty quickly. So probably a lot of you are using coding agents in your you know day-to-day work and we've seen some big success cases of agents. So um one example is there was this uh nice experiment um by um Carlini at anthropic that

1:39 saw could we develop a really complex piece of software using um a multi- aent uh configuration of a a recent coding model. And this was pretty successful. So 16 agents collaborated together over two weeks and constructed a rustbased C compiler which was able to compile the

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, Graham Neubig.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.