Interpretation of matrix calculus with Fréchet derivative
After a period of learning the Fréchet derivative, I look back to think about the problem of computing the derivative of $y = \Vert A x - b \Vert^2$ with respect to the variable $x$. I knew the der...