Solving an optimization problem with iterative methodology often have five ingredient: Modeling The problem with a set of unknowns or parameters to predict a datum’s label. Initialize A predi...

After a period of learning the Fréchet derivative, I look back to think about the problem of computing the derivative of $y = \Vert A x - b \Vert^2$ with respect to the variable $x$. I knew the der...