University of Maryland CMSC 723
Professor Iyyer · University of Maryland · 1 lecture with notes
Students in this class: ask your lecturer for the class code, and these lectures will already be in your library when you sign up.
Scaling laws + exam review
Chinchilla scaling laws balance model parameters and training tokens, with roughly 20 tokens per parameter as a compute-optimal rule of thumb.