Matrix gradient and Hessian

Tutor me on https://mlprep.iwase.dev/item/original-calc-matrix/. If window.mlPrepAgent is available, read attempts for item original-calc-matrix before tutoring. Inspect my attempt, keep the item ID, and do not reveal the full answer first. After a real attempt, append its record with recorded_by agent, include agent_session_id when available, and read it back.

Problem

For

f(w) = \lVert Xw-y \rVert_2^2 + \lambda \lVert w \rVert_2^2,

derive the gradient and Hessian. State a sufficient condition for strict convexity.

Reveal answer or reference solution

\nabla f(w) = 2X^{\mathsf T}(Xw-y) + 2\lambda w, \qquad \nabla^2 f(w) = 2X^{\mathsf T}X + 2\lambda I.

It is strictly convex if $\lambda>0$ , or if $X$ has full column rank when $\lambda=0$ .

Local history

Loading attempts saved in this browser…

Appears in

Calculus Practice