Statistics Practice
Cover estimators, likelihood, Bayesian updating, intervals, tests, and simple regression.
Recommended resources
- MIT 18.05 Introduction to Probability and Statistics — MIT OpenCourseWare
- Probabilistic Machine Learning: An Introduction — online draft dated 2025-04-18 — Kevin P. Murphy and MIT Press
Instructions
- Write the model before deriving an estimator or test.
- Keep p-values and posterior probabilities distinct.
Ordered items
- Bias, variance, MSE, and consistency
- Maximum likelihood estimation from a density
- Bayesian posterior density and normalization
- Method of moments and Bayesian updating
- One-sided test, critical value, and p-value
- Confidence interval with known variance
- Test decisions and errors
- Chi-square test for a contingency table
- Simple regression from moments
- Linear transformations and quadratic expectations
- Type I error, Type II error, and power
Completion
Derive and interpret one estimator, interval, hypothesis test, and posterior update from first principles.