| StatQuest with Josh Starmer |
Intro |
Short, step-by-step explanations of nearly every method in DATA 571 (trees, boosting, SVMs, PCA, regularization). |
| Luis Serrano Academy |
Intro |
Friendly visual intuition for neural nets, transformers and classical ML. |
| 3Blue1Brown |
Intro |
The “Neural networks” series: backpropagation, gradient descent and transformers drawn from first principles. |
| Welch Labs |
Intro |
Carefully animated stories of ML ideas (learning to see, the perceptron, backpropagation). |
| Stanford Online |
Intermediate |
Full lecture series: CS229 (machine learning), CS231n (vision), CS224N (NLP), and Hastie and Tibshirani’s Statistical Learning (ISLR). |
| caltech |
Intermediate |
Yaser Abu-Mostafa’s “Learning from Data” (CS 156): the theory of generalization, VC dimension and bias-variance, very clear. |
| Kilian Weinberger |
Intermediate |
Cornell CS4780 lectures; close in scope and level to DATA 571. |
| MIT OpenCourseWare |
Intermediate |
Lectures such as Introduction to Machine Learning and Introduction to Neural Networks and Deep Learning, plus related ML and statistics courses. |
| Alfredo Canziani |
Intermediate |
NYU Deep Learning (with Yann LeCun): history of deep learning, energy-based models, PyTorch, graduate level. |
| mathematicalmonk |
Intermediate |
Older but rigorous short lectures on ML and probability from a mathematical viewpoint. |
| Steve Brunton |
Intermediate |
SVD, PCA, regression and ML for science and engineering; pairs with his “Data-Driven Science and Engineering” book. |
| Mutual Information |
Intermediate |
Polished explainers on the theory behind ML: bias-variance, information theory, RL. |
| Andrej Karpathy |
Advanced |
“Neural Networks: Zero to Hero”: building autograd, language models and GPT from scratch in Python. |
| Pieter Abbeel |
Advanced |
Berkeley courses on his courses page: Deep Unsupervised Learning (Spring 2024, the source of the semi-supervised lecture video; also Spring 2020), Foundations of Deep RL and CS287 Advanced Robotics (Fall 2019), for deep learning and reinforcement learning courses after this one. |
| Umar Jamil |
Advanced |
Line-by-line implementations of transformers, diffusion models and LLM techniques such as LoRA in PyTorch. |
| DeepLearningAI |
Intermediate |
Andrew Ng’s Heroes of Deep Learning interviews and lessons from DeepLearning.AI courses, including the Machine Learning Specialization and the Deep Learning Specialization’s neural networks, regularization and optimization, project structuring and convolutional network courses. |
| Jeremy Howard |
Intermediate |
fast.ai “Practical Deep Learning for Coders”: top-down, code-first. |
| sentdex |
Intro |
Practical Python ML and deep learning tutorials. |
| Yannic Kilcher |
Research |
Long walk-throughs of ML papers, including classic papers. |
| AI Coffee Break with Letitia |
Research |
Short, accurate explainers on transformers, LLMs and diffusion models. |
| Two Minute Papers |
General |
Quick tours of new research results in AI and deep learning, plus graphics and generative models. |
| Machine Learning Street Talk |
Research |
Long interviews with ML researchers on theory and open problems, such as Francois Chollet on intelligence and generalisation and Andrew Wilson on why huge models work. |
| Simons Institute for the Theory of Computing |
Research |
Workshop talks on learning theory, optimization and deep learning theory. |