Save this video free

CSci574 / AI 520 Machine Learning: Classroom Session 11/05/2026

Derek Harter · 1:11:01 · Watch on YouTube

Part of East Texas A&M University CSCI 574. See all 20 lectures and search them

These notes were made with YouTube Collector. Paste any YouTube link and get the same: a summary, chapters and a searchable transcript.

Overview

Derek Harter explains how ensemble learning combines diverse classifiers through hard or soft voting, then introduces bagging, pasting, and out-of-bag evaluation as ways to diversify models trained with the same algorithm. Using scikit-learn examples on the make_moons dataset, he connects these methods to random forests and previews an assignment using the Magic Telescope dataset, five base classifiers, extra trees, and stacking.

Key takeaways

Chapters

0:00 Session Plan: Voting Ensembles and Assignment 6
3:00 Ensemble Accuracy Depends on Classifier Diversity
10:40 A Biased-Coin Example Illustrates Aggregation
15:20 Hard Voting with Logistic Regression, Trees, and SVC
20:40 Using scikit-learn VotingClassifier as an Estimator
27:00 Hard-Voting Results and Unstable Test Scores
28:30 Soft Voting Weights Classifiers by Predicted Probabilities
37:30 When to Combine Different Classifier Families
41:10 Bagging and Pasting Sample Training Data or Features
46:00 Parallel Training and Bias-Variance Effects of Sampling
50:00 scikit-learn BaggingClassifier and Bootstrap Samples
53:30 Comparing Bagged and Individual Tree Boundaries
57:00 Out-of-Bag Evaluation from Unused Bootstrap Examples
1:04:30 Assignment 6: Magic Telescope, Extra Trees, and Stacking

Keep these chapters and the full searchable transcript in your own library.

Transcript excerpt

0:50 All right. Good afternoon. Excuse me. Let's go and get started here. Got a few online, looks like. Um So, let me know if you guys can't hear me. Hopefully hopefully I got everything going here. Um So, yeah, to begin with, so don't forget I'm I'm going to be talking about our assignment on ensemble learning, but that that's you still have a little bit of time on that, but if I get a chance here at the end, I'll maybe bring that up. Make sure that the link is working. I haven't checked if people have accepted the assignment yet and started working on it. So, yeah, I mean, my plan today is we we kind of got through most all the decision tree stuff, so that's actually the uh

1:38 uh the chapter six kinds of materials, at least the main stuff. Um so, yeah, I'm going to start with talking about ensemble learning and forest a bit here today. So, you're I mean, base basically that's what you're going to be doing on the next assignment that you guys should be working on right now, the assignment six. Um it's kind of doing a bit building some ensembles by hand, which is sort of what goes on in the first part of this uh chapter here, and then talking a little bit uh and then the assignment has a little bit about using some random forests, and then doing some of this stuff with like the stacking sorts of things in the assignment. So, Okay doc. Let's Let's go ahead.

2:29 Um and uh get started here. Um So, I I just I I I'm planning today. I think I'm mostly just going to talk about uh ensemble uh like voting classifiers, and kind of try and stop

This is the start of the transcript. Save this video free for the whole transcript, searchable and time-coded.

In this course

Related notes

Summary, takeaways, and chapters were generated by AI from the video's transcript and may contain errors. The video belongs to its creator, Derek Harter.

Want the full transcript?

Save this video in YouTube Collector to get its complete searchable transcript, your own AI summaries, and a library that keeps every video you collect in one place.