All Topics  
Gradient

 

   Email Print
   Bookmark   Link






 

Gradient



 
 
In vector calculus
Vector calculus

Vector calculus is a branch of mathematics concerned with derivative and integral of vector fields. The term "vector calculus" is sometimes used as a synonym for the broader subject of multivariable calculus, which includes vector calculus as well as partial derivative and multiple integral....
, the gradient of a scalar field
Scalar field

In mathematics and physics, a scalar field associates a scalar value, which can be either scalar in definition, or scalar , to every point in space....
 is a vector field
Vector field

In mathematics a vector field is a construction in vector calculus which associates a vector to every point in a Euclidean space.Vector fields are often used in physics to model, for example, the speed and direction of a moving fluid throughout space, or the strength and direction of some force, such as the magnetic field or gravity for...
 which points in the direction of the greatest rate of increase of the scalar field, and whose magnitude
Magnitude (mathematics)

The magnitude of a mathematical object is its size: a property by which it can be larger or smaller than other objects of the same kind; in technical terms, an ordering of the class of objects to which it belongs....
 is the greatest rate of change.

A generalization of the gradient for functions on a Euclidean space
Euclidean space

Around 300 Before Christ, the Ancient Greece mathematician Euclid undertook a study of relationships among distances and angles, first in a plane and then in space....
 which have values in another Euclidean space is the Jacobian
Jacobian

In vector calculus, the Jacobian is shorthand for either the Jacobian matrix or its determinant, the Jacobian determinant.In algebraic geometry the Jacobian of a algebraic curve means the Jacobian variety: a group variety associated to the curve, in which the curve can be embedded....
.






Discussion
Ask a question about 'Gradient'
Start a new discussion about 'Gradient'
Answer questions from other users
Full Discussion Forum



Encyclopedia


Gradient2
In vector calculus
Vector calculus

Vector calculus is a branch of mathematics concerned with derivative and integral of vector fields. The term "vector calculus" is sometimes used as a synonym for the broader subject of multivariable calculus, which includes vector calculus as well as partial derivative and multiple integral....
, the gradient of a scalar field
Scalar field

In mathematics and physics, a scalar field associates a scalar value, which can be either scalar in definition, or scalar , to every point in space....
 is a vector field
Vector field

In mathematics a vector field is a construction in vector calculus which associates a vector to every point in a Euclidean space.Vector fields are often used in physics to model, for example, the speed and direction of a moving fluid throughout space, or the strength and direction of some force, such as the magnetic field or gravity for...
 which points in the direction of the greatest rate of increase of the scalar field, and whose magnitude
Magnitude (mathematics)

The magnitude of a mathematical object is its size: a property by which it can be larger or smaller than other objects of the same kind; in technical terms, an ordering of the class of objects to which it belongs....
 is the greatest rate of change.

A generalization of the gradient for functions on a Euclidean space
Euclidean space

Around 300 Before Christ, the Ancient Greece mathematician Euclid undertook a study of relationships among distances and angles, first in a plane and then in space....
 which have values in another Euclidean space is the Jacobian
Jacobian

In vector calculus, the Jacobian is shorthand for either the Jacobian matrix or its determinant, the Jacobian determinant.In algebraic geometry the Jacobian of a algebraic curve means the Jacobian variety: a group variety associated to the curve, in which the curve can be embedded....
. A further generalization for a function from one Banach space
Banach space

In mathematics, Banach spaces are one of the central objects of study in functional analysis. They are topological vector spaces that have many interesting properties associated with them....
 to another is the Fréchet derivative
Fréchet derivative

In mathematics, the Fr?chet derivative is a derivative defined on Banach spaces. Named after Maurice Fr?chet, it is commonly used to formalize the concept of the functional derivative used widely in mathematical analysis, especially functional analysis....
.

Interpretations of the gradient

For instance, consider a room in which the temperature is given by a scalar field , so at each point the temperature is (we will assume that the temperature does not change in time). Then, at each point in the room, the gradient of at that point will show the direction in which the temperature rises most quickly. The magnitude of the gradient will determine how fast the temperature rises in that direction.

Consider a hill whose height above sea level at a point is . The gradient of at a point is a vector pointing in the direction of the steepest slope
Slope

Slope is used to describe the steepness, incline, gradient, or grade of a line . A higher slope value indicates a steeper incline. The slope is defined as the ratio of the "rise" divided by the "run" between two points on a line, or in other words, the ratio of the altitude change to the horizontal distance between any two point...
 or grade at that point. The steepness of the slope at that point is given by the magnitude of the gradient vector.

The gradient can also be used to measure how a scalar field changes in other directions, rather than just the direction of greatest change, by taking a dot product
Dot product

In mathematics, the dot product, also known as the scalar product, is an operation which takes two vector over the real numbers R and returns a real-valued scalar quantity....
. Consider again the example with the hill and suppose that the steepest slope on the hill is 40%. If a road goes directly up the hill, then the steepest slope on the road will also be 40%. If, instead, the road goes around the hill at an angle (the gradient vector), then it will have a shallower slope. For example, if the angle between the road and the uphill direction, projected onto the horizontal plane, is 60°, then the steepest slope along the road will be 20%, which is 40% times the cosine of 60°.

This observation can be mathematically stated as follows. If the hill height function is differentiable, then the gradient of dotted
Dot product

In mathematics, the dot product, also known as the scalar product, is an operation which takes two vector over the real numbers R and returns a real-valued scalar quantity....
 with a unit vector gives the slope of the hill in the direction of the vector. More precisely, when is differentiable, the dot product of the gradient of with a given unit vector is equal to the directional derivative
Directional derivative

In mathematics, the directional derivative of a multivariate differentiable function along a given vector V at a given point P intuitively represents the instantaneous rate of change of the function, moving through P, in the direction of V....
 of in the direction of that unit vector.

Definition


The gradient (or gradient vector field) of a scalar function with respect to a vector variable is denoted by or where (the nabla symbol
Nabla symbol

Nabla is the symbol . The name comes from the Greek language word for a Hebrew harp, which had a similar shape. Related words also exist in Aramaic language and Hebrew language....
) denotes the vector differential operator
Differential operator

In mathematics, a differential operator is an operator defined as a function of the derivative operator. It is helpful, as a matter of notation first, to consider differentiation as an abstract operation, accepting a function and returning another ....
, del
Del

In vector calculus, del is a vector differential operator represented by the nabla symbol: .Del is a mathematical tool serving primarily as a Convention for mathematical notation; it makes many equations easier to comprehend, write, and remember....
. The notation is also used for the gradient. The gradient of f is defined to be the vector field
Vector field

In mathematics a vector field is a construction in vector calculus which associates a vector to every point in a Euclidean space.Vector fields are often used in physics to model, for example, the speed and direction of a moving fluid throughout space, or the strength and direction of some force, such as the magnetic field or gravity for...
 whose components are the partial derivatives
Partial derivative

In mathematics, a partial derivative of a function of several variables is its derivative with respect to one of those variables with the others held constant ....
 of . That is:
Here the gradient is written as a row vector
Row vector

In linear algebra, a row vector or row matrix is a 1 × n matrix , that is, a matrix consisting of a single row:The transpose of a row vector is a column vector:...
, but it is often taken to be a column vector
Column vector

In linear algebra, a column vector or column matrix is an m × 1 matrix , i.e. a matrix consisting of a single column of elements....
. When a function also depends on a parameter such as time, the gradient often refers simply to the vector of its spatial derivatives only.

Expressions for the gradient in 3 dimensions

The form of the gradient depends on the coordinate system used.

In Cartesian coordinates, the above expression expands to

which is often written using the standard versor
Versor

In mathematics, a versor is a directed great-circle arc that corresponds to a quaternion of Norm one. In geometry and physics, a versor is sometimes defined as a unit vector indicating the Orientation of a directed axis or of another vector....
s i, j, k:

In cylindrical coordinates, the gradient is given by :

where is the azimuthal angle, is the axial coordinate, and eρ, eθ and ez are unit vectors pointing along the coordinate directions.

In spherical coordinates :

where is the azimuth
Azimuth

An Azimuth is the angle from a reference vector space in a reference plane to a second vector in the same plane, pointing toward, , something of interest....
 angle and is the zenith
Zenith

In broad terms, the zenith is the direction pointing directly above a particular location . Since the concept of being above is itself somewhat vague, scientists define the zenith in more rigorous terms....
 angle.

Example

For example, the gradient of the function in Cartesian coordinates
is:

The gradient and the derivative or differential


Linear approximation to a function

The gradient of a function
Function (mathematics)

The mathematical concept of a function expresses dependence between two quantities, one of which is known and the other which is produced. A function associates a single output to each input element drawn from a fixed Set , such as the real numbers , although different inputs may have the same output....
  from the Euclidean space
Euclidean space

Around 300 Before Christ, the Ancient Greece mathematician Euclid undertook a study of relationships among distances and angles, first in a plane and then in space....
  to at any particular point x0 in characterizes the best linear approximation
Linear approximation

In mathematics, a linear approximation is an approximation of a general function using a linear function ....
 to f at x0. The approximation is as follows: for close to , where is the gradient of f computed at , and the dot denotes the dot product
Dot product

In mathematics, the dot product, also known as the scalar product, is an operation which takes two vector over the real numbers R and returns a real-valued scalar quantity....
 on . This equation is equivalent to the first two terms in the multi-variable Taylor Series
Taylor series

In mathematics, the Taylor series is a representation of a function as an Series of terms calculated from the values of its derivatives at a single point....
 expansion of f at x0.

The differential or (exterior) derivative


The best linear approximation to a function at a point in is a linear map from to which is often denoted by or and called the differential
Differential (calculus)

In calculus, a differential is traditionally an infinitesimally small change in a variable. For example, if x is a variable, then a change in the value of x is often denoted ?x ....
 or (total) derivative
Total derivative

In the mathematics of differential calculus, the term total derivative has a number of closely related meanings.* The total derivative of a function, f, of several variables, e.g., t,x,y, etc., with respect to one of its input variables, e.g., t, is different from the partial derivative....
 of at . The gradient is therefore related to the differential by the formula for any . The function , which maps to , is called the differential or exterior derivative
Exterior derivative

In differential geometry, the exterior derivative extends the concept of the differential of a function, which is a form of degree zero, to differential forms of higher degree....
 of and is an example of a differential 1-form.

If is viewed as the space of (length ) column vectors (of real numbers), then one can regard as the row vector so that is given by matrix multiplication. The gradient is then the corresponding column vector, i.e., .

Gradient as a derivative

Let U be an open set
Open set

In metric topology and related fields of mathematics, a Set U is called open if, intuitively speaking, starting from any point x in U one can move by a small amount in any direction and still be in the set U....
 in Rn. If the function f:U → R is differentiable
Fréchet derivative

In mathematics, the Fr?chet derivative is a derivative defined on Banach spaces. Named after Maurice Fr?chet, it is commonly used to formalize the concept of the functional derivative used widely in mathematical analysis, especially functional analysis....
, then the differential of f is the (Fréchet) derivative
Fréchet derivative

In mathematics, the Fr?chet derivative is a derivative defined on Banach spaces. Named after Maurice Fr?chet, it is commonly used to formalize the concept of the functional derivative used widely in mathematical analysis, especially functional analysis....
 of f. Thus is a function from U to the space R such that where • is the dot product.

As a consequence, the usual properties of the derivative hold for the gradient:

Linearity The gradient is linear in the sense that if f and g are two real-valued functions differentiable at the point aRn, and α and β are two constants, then αfg is differentiable at a, and moreover

Product rule If f and g are real-valued functions differentiable at a point aRn, then the product rule
Product rule

In calculus, the product rule is a formula used to find the derivatives of products of functions.It may be stated thus:or in the Leibniz notation thus:...
 asserts that the product (fg)(x) = f(x)g(x) of the functions f and g is differentiable at a, and

Chain rule Suppose that f:AR is a real-valued function defined on a subset A of Rn, and that f is differentiable at a point a. There are two forms of the chain rule applying to the gradient. First, suppose that the function g is a parametric curve; that is, a function g : IRn maps a subset IR into Rn. If g is differentiable at a point cI such that g(c) = a, then

More generally, if instead IRk, then the following holds:

where (Dg)T denotes the transpose Jacobian matrix.

For the second form of the chain rule, suppose that h : IR is a real valued function on a subset I of R, and that h is differentiable at the point c = f(a) ∈ I. Then

Transformation properties

Although the gradient is defined in term of coordinates, it is contravariant under the application of an orthogonal matrix
Orthogonal matrix

In matrix theory, a real number orthogonal matrix is a Matrix #Square matrices Q whose transpose is its inverse matrix:A special orthogonal matrix is an orthogonal matrix with determinant +1:...
 to the coordinates. This is true in the sense that if A is an orthogonal matrix, then

which follows by the chain rule above. A vector transforming in this way is known as a contravariant vector, and so the gradient is a special type of tensor
Tensor

A tensor is an object which extends the notion of Scalar , Vector , and Matrix . The term has slightly different meanings in mathematics and physics....
.

The differential is more natural than the gradient because it is invariant under all coordinate transformations (or diffeomorphism
Diffeomorphism

In mathematics, a diffeomorphism is an isomorphism of smooth manifolds. It is an invertible function that map s one differentiable manifold to another, such that both the function and its inverse are smooth function....
s), whereas the gradient is only invariant under orthogonal transformations (because of the implicit use of the dot product in its definition). Because of this, it is common to blur the distinction between the two concepts using the notion of covariant and contravariant vectors. From this point of view, the components of the gradient transform covariantly under changes of coordinates, so it is called a covariant vector field, whereas the components of a vector field in the usual sense transform contravariantly. In this language the gradient is the differential, as a covariant vector field is the same thing as a differential 1-form.



Further properties and applications


Level sets

If the partial derivatives of f are continuous, then the dot product
Dot product

In mathematics, the dot product, also known as the scalar product, is an operation which takes two vector over the real numbers R and returns a real-valued scalar quantity....
  of the gradient at a point x with a vector v gives the directional derivative
Directional derivative

In mathematics, the directional derivative of a multivariate differentiable function along a given vector V at a given point P intuitively represents the instantaneous rate of change of the function, moving through P, in the direction of V....
 of f at x in the direction v. It follows that in this case the gradient of f is orthogonal to the level set
Level set

In mathematics, a level set of a real number-valued function f of n variables is a set of the formwhere c is a constant. That is, it is the set where the function takes on a given constant value....
s of f.

Because the gradient is orthogonal to level sets, it can be used to construct a vector normal to a surface. Consider any manifold
Manifold

In mathematics, more specifically topology, a manifold is a topological space in which every point has a neighborhood which "resembles" Euclidean space....
 that is one dimension less than the space it is in (e.g., a surface in 3D, a curve in 2D, etc.). Let this manifold be defined by an equation e.g. F(x, y, z) = 0 (i.e., move everything to one side of the equation). We have now turned the manifold into a level set. To find a normal vector, we simply need to find the gradient of the function F at the desired point.

Conservative vector fields


The gradient of a function is called a gradient field. A gradient field is always a conservative vector field: line integrals through a gradient field are path-independent and can be evaluated with the gradient theorem
Gradient theorem

The gradient theorem, also known as the fundamental theorem of calculus for line integrals, says that a line integral through a gradient field can be evaluated by evaluating the original scalar field at the endpoints of the curve:...
 (the fundamental theorem of calculus for line integrals). Conversely, a conservative vector field in a simply connected region is always the gradient of a function.

The gradient on Riemannian manifolds

For any smooth function f on a Riemannian manifold
Riemannian manifold

In Riemannian geometry, a Riemannian manifold is a real differentiable manifold M in which each tangent space is equipped with an Inner product space g in a manner which varies smoothly from point to point....
 (M,g), the gradient of f is the vector field
Vector field

In mathematics a vector field is a construction in vector calculus which associates a vector to every point in a Euclidean space.Vector fields are often used in physics to model, for example, the speed and direction of a moving fluid throughout space, or the strength and direction of some force, such as the magnetic field or gravity for...
  such that for any vector field , where denotes the inner product of tangent vectors at x defined by the metric g and (sometimes denoted X(f)) is the function that takes any point xM to the directional derivative
Directional derivative

In mathematics, the directional derivative of a multivariate differentiable function along a given vector V at a given point P intuitively represents the instantaneous rate of change of the function, moving through P, in the direction of V....
 of f in the direction X, evaluated at x. In other words, in a coordinate chart from an open subset of M to an open subset of Rn, is given by: where Xj denotes the jth component of X in this coordinate chart.

So, the local form of the gradient takes the form:

Generalizing the case M=Rn, the gradient of a function is related to its exterior derivative
Exterior derivative

In differential geometry, the exterior derivative extends the concept of the differential of a function, which is a form of degree zero, to differential forms of higher degree....
, since . More precisely, the gradient is the vector field associated to the differential 1-form df using the musical isomorphism
Musical isomorphism

In mathematics, the musical isomorphism is an isomorphism between the tangent bundle TM and the cotangent bundle of a Riemannian manifold given by its Riemannian metric....
  (called "sharp") defined by the metric g. The relation between the exterior derivative and the gradient of a function on Rn is a special case of this in which the metric is the flat metric given by the dot product.

See also

  • Curl
  • Divergence
    Divergence

    In vector calculus, the divergence is an operator that measures the magnitude of a vector field's source or sink at a given point; the divergence of a vector field is a scalar....
  • Electrochemical gradient
    Electrochemical gradient

    An electrochemical gradient is a spatial variation of both electrical potential and chemical concentration across a membrane. Both components are often due to ion gradients, particularly proton gradients, and the result can be a type of potential energy available for work in a cell....
  • Fall line (skiing)
    Fall line (skiing)

    In alpine skiing, a fall line refers to the line down a mountain or hill which is most directly downhill. That is, the direction a ball would roll if it was free to move on the slope under gravity....
  • Grade (slope)
  • Gradient descent
    Gradient descent

    Gradient descent is an optimization algorithm. To find a local minimum of a function using gradient descent, one takes steps proportional to the negative of the gradient of the function at the current point....
  • Laplace operator
    Laplace operator

    In mathematics and physics, the Laplace operator or Laplacian, denoted by   or   and named after Pierre-Simon de Laplace, is a differential operator, specifically an important case of an elliptic operator, with many applications....
  • Level set
    Level set

    In mathematics, a level set of a real number-valued function f of n variables is a set of the formwhere c is a constant. That is, it is the set where the function takes on a given constant value....
  • Musical isomorphism
    Musical isomorphism

    In mathematics, the musical isomorphism is an isomorphism between the tangent bundle TM and the cotangent bundle of a Riemannian manifold given by its Riemannian metric....
  • Nabla
    Del

    In vector calculus, del is a vector differential operator represented by the nabla symbol: .Del is a mathematical tool serving primarily as a Convention for mathematical notation; it makes many equations easier to comprehend, write, and remember....
  • Slope
    Slope

    Slope is used to describe the steepness, incline, gradient, or grade of a line . A higher slope value indicates a steeper incline. The slope is defined as the ratio of the "rise" divided by the "run" between two points on a line, or in other words, the ratio of the altitude change to the horizontal distance between any two point...
  • Sobel operator
  • Surface gradient
    Surface gradient

    In vector calculus, the surface gradient is a Vector differential operator that is similar to the conventional gradient. The distinction is that the surface gradient takes effect along a surface....


External links

  • at Wolfram MathWorld
  • on gradient vectors