Gradient, Hessian, Jacobian

Explained:

gradient

Hessian

Jacobian


 
   

The gradient and Hessian of a function f: are the vector of its first partial derivatives and matrix of its second partial derivatives:

[1]

The Hessian is symmetric if the second partials are continuous.

The Jacobian J f of a function f: is the matrix of its first partial derivatives.

   
[2]

Note that the Hessian of a function f: is the Jacobian of its gradient.

 

Exercises

Consider the function: h(x,y) = x2y. Calculate its gradient at the point (2,5). [solution]

Sponsored Links

 

Related Internal Links

Cholesky matrix A lower-triangular matrix that acts as a matrix "square root" for a positive definite matrix.

eigenvalue, eigenvector Concepts from linear algebra.

interpolation Any procedure for fitting a function to a set of points in such a manner that the function intercepts each of the points.

positive definite matrix A real symmetric matrix, all of whose eigenvalues are real and positive.

Taylor series expansion In calculus, a power series obtained as a limit of Taylor polynomials that may approximate or equal the function from which it is constructed.

Sponsored Links

http://www.riskglossary.com

copyright © Glyn A. Holton, 2006

Although the information in this website has been presented with care and obtained from sources the author believes to be reliable, there is no guarantee that it is accurate. Such information may be incomplete, condensed, outdated or presented with errors. The content of the website is for information purposes only. It is provided gratuitously, so the author shall not be liable under any theory for any damages suffered by any user. The author does not provide investment advice, and this website is not a vehicle for communicating investment advice.