# Diagnose model evaluation failures

> ML preparation item.

- Stable ID: `mit-6-036-s2019-midterm-q4`
- Area: Machine Learning
- Topic: Theory
- Origin: external
- Expected time: 15 minutes
- Skills: bias-variance, generalization, overfitting, train-validation-test, model-complexity
- Item JSON: https://mlprep.iwase.dev/data/items/mit-6-036-s2019-midterm-q4.json

This site does not reproduce the third-party problem.

- Source: MIT 6.036 Introduction to Machine Learning Exams
- Document: Spring 2019 Midterm Exam
- Locator: Question 4: Model Evaluation, problem PDF pp. 13–14
- Official answer PDF page(s): 13–14
- Original problem: https://introml.mit.edu/_static/spring23/midterm/review/midterm_spring2019.pdf#page=13
- Official answer: https://introml.mit.edu/_static/spring23/midterm/review/midterm_solutions_spring2019.pdf#page=13
- Answer status: official-solution


## Tutoring contract

Ask for the learner's attempt, begin with the smallest useful hint, preserve item ID `mit-6-036-s2019-midterm-q4`, and record a real attempt with `recorded_by: "agent"` and `agent_session_id` when available using https://mlprep.iwase.dev/schema/attempt-record.json.
