Save this video free

Princeton Intro to Robotics (Fall 2026) | Lecture 14: Visual SLAM

Introduction to Robotics @ Princeton · 1:06:28 · Watch on YouTube

Part of Princeton University ROB 345. See all 15 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

The lecture connects occupancy-grid SLAM to visual SLAM, where RGB images alone are used to estimate camera poses, depth, 3D point maps, and cross-frame features. It explains VGGT (Visual Geometry Grounded Transformer) as a learned alternative to classical bundle adjustment, then develops bundle adjustment’s reprojection-error objective and the practical problems of calibration, mismatched correspondences, outliers, initialization, and scale ambiguity.

Key takeaways

Chapters

0:00 Occupancy-Grid SLAM Recap: Jointly Estimating Map and Robot State
5:39 Visual SLAM Shifts the Input to RGB Images Only
8:00 VGGT Builds 3D Point Clouds from One to 128 Images
12:00 VGGT’s Inputs and Four Per-Image Outputs
14:00 Depth Maps, Point Maps, and Camera Pose Estimates
22:00 VGGT Features Link Physical Points Across Images
28:00 Classical SLAM Begins with Camera Calibration and Correspondence
33:00 Bundle Adjustment Minimizes Reprojection Error
43:00 Visibility Masks and Huber Loss Handle Bad Measurements
46:00 Levenberg-Marquardt Refines Poses and 3D Points
52:00 Why Classical Visual SLAM Can Be Brittle in Practice
55:00 VGGT Learns Geometry Priors to Estimate Metric Scale
1:01:00 Midterm Scope and Drone-Availability Feedback

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:10 All right, I think we'll get started. Yeah, I guess welcome back from from break. Hopefully you had at least a few relaxing days. So the plan for today is to continue with our discussion of localization and mapping, specifically slam, so simultaneous localization and mapping. So in the last couple of lectures, we saw an application of particle filtering in particular, which is itself an instantiation of the the base filter to this problem of slam. So simultaneously localizing your robot in some environment and then figuring out what the environment looks like. And I want to just give give you a quick recap since since it's been a a few days. So the main kind of method for slam that we discussed was what's known as occupancy grid mapping. So this is an example of a drone that's

0:57 flying around in this environment. This left top left view is a first person view. So RGB camera views from the drone. This is a third person view. And then this is the the map that the drone is building as it's going along. So as it's going along, it's collecting sensor information from on board sensors. So cameras like RGB cameras, depth cameras. And it's building this map. So it's localizing itself. So it's figuring out where in the environment the the drone is. And then it's figuring out what the the map looks like. And specifically what we discussed was occupancy grid mapping. So in occupancy grid mapping, you have some discrete representation of the environment. So you discretize your your space.

1:45 And then you basically just represent for each cell whether that cell is occupied or not. So it's it's a one if that cell is occupied. It's a zero if that cell is not occupied. And yeah, you basically just

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, Introduction to Robotics @ Princeton.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.