Theory

Reason about bias, variance, overfitting, generalization, and evaluation splits.

Recommended resources

Instructions

  1. Use observed train-validation patterns rather than vague model-size rules.

Ordered items

  1. Diagnose model evaluation failuresTheory · Medium · 15 min · External
  2. Lasso versus ridge penaltiesOptimization · Easy · 6 min · Original
  3. Read a finite-class generalization boundTheory · Medium · 7 min · Original
  4. Generalization and overfitting knowledge checkTheory · Easy · 10 min · External
  5. BIC for a two-dimensional discrete distributionTheory · Medium · 20 min · External

Completion

Recommend a defensible response to one bias and one variance failure mode.