Definitions by Module

Published

Last modified: 2026-11-19

Every definition in the notes, listed by module and page in the order the notes present them. Each row numbers the definition within its page and across the whole list, so the last overall number counts every definition. The list is built from the notes themselves, so it cannot fall out of step with them. The glossary explains the key terms in plain words and points to where each is defined. The results are listed the same way.

M1: Course Overview

Course Overview: What Is Machine Learning?

Table 1: The definitions on Course Overview: What Is Machine Learning?, in page order.

Anatomy of a Learning Problem

M2: Linear Regression

Linear Regression

Interactions, Inference and Diagnostics

Multivariate-Outcome Linear Regression

Table 5: The definitions on Multivariate-Outcome Linear Regression, in page order.
On page Overall Definition
1 81 Multivariate linear regression

M3: ML Fundamentals

A First Model, End to End

Generalization and Cross-Validation

Bias, Variance and Residual Variance

Kinds of Learning Problems and Features

M4: Classification and Logistic Regression

Classification Problems

Table 10: The definitions on Classification Problems, in page order.
On page Overall Definition
1 139 Decision region
2 140 Decision boundary

Logistic Regression

Table 11: The definitions on Logistic Regression, in page order.
On page Overall Definition
1 141 Logistic regression
2 142 Link function
3 143 Probit regression
4 144 Complementary log-log regression

Gradient Descent

Table 12: The definitions on Gradient Descent, in page order.

Fitting Logistic Regression

Table 13: The definitions on Fitting Logistic Regression, in page order.

Predictions and Inference for Logistic Regression

Table 14: The definitions on Predictions and Inference for Logistic Regression, in page order.

Multiclass Logistic Regression

Discriminant Analysis

M5: Performance Metrics

Metrics

M6: Regularization and Model Selection

Subset Selection

Table 18: The definitions on Subset Selection, in page order.
On page Overall Definition
1 193 Forward selection
2 194 Backward selection
3 195 Best subset selection

Regularization

Model Selection

M7: Support Vector Machines and Kernel Methods

Support Vector Machines

Table 21: The definitions on Support Vector Machines, in page order.

M8: Neural Networks and Backpropagation

Neural Networks

Table 22: The definitions on Neural Networks, in page order.

Backpropagation

M9: ML Experimentation

Machine Learning Experimentation

Table 24: The definitions on Machine Learning Experimentation, in page order.
On page Overall Definition
1 244 Inner loop
2 245 Outer loop
3 246 Data snooping
4 247 Sampling bias

M10: Clustering

Unsupervised Learning

Table 25: The definitions on Unsupervised Learning, in page order.

Optional Reading: Theory

Machine Learning Theory

Table 26: The definitions on Machine Learning Theory, in page order.
On page Overall Definition
1 251 Inductive bias
2 252 Shattering
3 253 Growth function
4 254 VC dimension

Optional Reading: Non-Parametric Models

Non-Parametric Models

Table 27: The definitions on Non-Parametric Models, in page order.
On page Overall Definition
1 255 K nearest neighbors
2 256 K-nearest neighbors regression
3 257 Local linear regression
4 258 Span
5 259 LOESS

Splines

Generalized Additive Models

Table 29: The definitions on Generalized Additive Models, in page order.
On page Overall Definition
1 265 Component function
2 266 Additive model
3 267 Generalized additive model
4 268 Backfitting

Optional Reading: Trees and Ensembles

Decision Trees

Table 30: The definitions on Decision Trees, in page order.

Optional Reading: Further Methods

Gaussian Processes

Table 31: The definitions on Gaussian Processes, in page order.
On page Overall Definition
1 271 Gaussian process
2 272 Mean function
3 273 Covariance function (kernel)
4 274 Hyperparameters
5 275 Marginal likelihood

Convolutional and Recurrent Networks

Attention and Transformers

Table 33: The definitions on Attention and Transformers, in page order.
Back to top