All Topics  
Convex function

 

   Email Print
   Bookmark   Link






 

Convex function



 
 
In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, a real-valued function
Function (mathematics)

The mathematical concept of a function expresses dependence between two quantities, one of which is known and the other which is produced. A function associates a single output to each input element drawn from a fixed Set , such as the real numbers , although different inputs may have the same output....
 f defined on an interval
Interval (mathematics)

In mathematics, a interval is a set of real numbers with the property that any number that lies between two numbers in the set is also included in the set....
 (or on any convex subset of some vector space
Vector space

File:Vector addition ans scaling.pngA vector space is a mathematical structure formed by a collection of vectors: objects that may be Vector addition together and Scalar multiplication by numbers, called scalar s in this context....
) is called convex, concave upwards, concave up or convex cup, if for any two points x and y in its domain
Domain (mathematics)

In mathematics, the domain of a given function is the set of "input" values for which the function is defined. For instance, the domain of cosine would be all real numbers, while the domain of the square root would be only numbers greater than or equal to 0 ....
 C and any t in [0,1], we have

In other words, a function is convex if and only if
If and only if

If and only if, in logic and fields that rely on it such as mathematics and philosophy, is a biconditional logical connective between statements....
 its epigraph
Epigraph (mathematics)

In mathematics, the epigraph of a function f : Rn?R is the Set of points lying on or above its graph of a function:...
 (the set of points lying on or above the graph
Graph of a function

In mathematics, the graph of a function f is the collection of all ordered pairs . In particular, if x is a real number, graph means the graphical representation of this collection, in the form of a curve on a Cartesian coordinate system, together with Cartesian axes, etc....
) is a convex set
Convex set

In Euclidean space, an object is convex if for every pair of points within the object, every point on the straight line segment that joins them is also within the object....
.

Pictorially, a function is called 'convex' if the function lies below the straight line segment connecting two points, for any two points in the interval.

A function is called strictly convex if for any t in (0,1) and

A function is said to be concave
Concave function

In mathematics, a concave function is the additive inverse of a convex function. A concave function is also synonymously called concave downwards, concave down, convex cap or upper convex....
 if is convex.

nvex function f defined on some open interval C is continuous
Continuous function

In mathematics, a continuous function is a function for which, intuitively, small changes in the input result in small changes in the output. Otherwise, a function is said to be discontinuous....
 on C and differentiable
Derivative

In calculus, a branch of mathematics, the derivative is a measure of how a function changes as its input changes. Loosely speaking, a derivative can be thought of as how much a quantity is changing at a given point....
 at all but at most countably many points.






Discussion
Ask a question about 'Convex function'
Start a new discussion about 'Convex function'
Answer questions from other users
Full Discussion Forum



Recent Posts









Encyclopedia


In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, a real-valued function
Function (mathematics)

The mathematical concept of a function expresses dependence between two quantities, one of which is known and the other which is produced. A function associates a single output to each input element drawn from a fixed Set , such as the real numbers , although different inputs may have the same output....
 f defined on an interval
Interval (mathematics)

In mathematics, a interval is a set of real numbers with the property that any number that lies between two numbers in the set is also included in the set....
 (or on any convex subset of some vector space
Vector space

File:Vector addition ans scaling.pngA vector space is a mathematical structure formed by a collection of vectors: objects that may be Vector addition together and Scalar multiplication by numbers, called scalar s in this context....
) is called convex, concave upwards, concave up or convex cup, if for any two points x and y in its domain
Domain (mathematics)

In mathematics, the domain of a given function is the set of "input" values for which the function is defined. For instance, the domain of cosine would be all real numbers, while the domain of the square root would be only numbers greater than or equal to 0 ....
 C and any t in [0,1], we have

Convex Function Graph 1
In other words, a function is convex if and only if
If and only if

If and only if, in logic and fields that rely on it such as mathematics and philosophy, is a biconditional logical connective between statements....
 its epigraph
Epigraph (mathematics)

In mathematics, the epigraph of a function f : Rn?R is the Set of points lying on or above its graph of a function:...
 (the set of points lying on or above the graph
Graph of a function

In mathematics, the graph of a function f is the collection of all ordered pairs . In particular, if x is a real number, graph means the graphical representation of this collection, in the form of a curve on a Cartesian coordinate system, together with Cartesian axes, etc....
) is a convex set
Convex set

In Euclidean space, an object is convex if for every pair of points within the object, every point on the straight line segment that joins them is also within the object....
.

Pictorially, a function is called 'convex' if the function lies below the straight line segment connecting two points, for any two points in the interval.

A function is called strictly convex if for any t in (0,1) and

A function is said to be concave
Concave function

In mathematics, a concave function is the additive inverse of a convex function. A concave function is also synonymously called concave downwards, concave down, convex cap or upper convex....
 if is convex.

Properties

A convex function f defined on some open interval C is continuous
Continuous function

In mathematics, a continuous function is a function for which, intuitively, small changes in the input result in small changes in the output. Otherwise, a function is said to be discontinuous....
 on C and differentiable
Derivative

In calculus, a branch of mathematics, the derivative is a measure of how a function changes as its input changes. Loosely speaking, a derivative can be thought of as how much a quantity is changing at a given point....
 at all but at most countably many points. If C is closed, then f may fail to be continuous at the endpoints of C.

A function is midpoint convex on an interval C if for all x and y in C. This condition is only slightly weaker than convexity. For example, a real valued Lebesgue measurable function that is midpoint convex will be convex . In particular, a continuous function that is midpoint convex will be convex.

A differentiable function of one variable is convex on an interval if and only if its derivative
Derivative

In calculus, a branch of mathematics, the derivative is a measure of how a function changes as its input changes. Loosely speaking, a derivative can be thought of as how much a quantity is changing at a given point....
 is monotonically non-decreasing on that interval.

A continuously differentiable function of one variable is convex on an interval if and only if the function lies above all of its tangent
Tangent

In geometry, the tangent line to a curve at a given Point is the straight line that "just touches" the curve at that point . As it passes through the point of tangency, the tangent line is "going in the same direction" as the curve, and in this sense it is the best straight-line approximation to the curve at that point....
s: f(y) = f(x) + f '(x) (yx) for all x and y in the interval. In particular, if f '(c) = 0, then c is a global minimum of f(x).

A twice differentiable function of one variable is convex on an interval if and only if its second derivative is non-negative there; this gives a practical test for convexity. If its second derivative is positive then it is strictly convex, but the converse does not hold. For example, the second derivative of f(x) = x4 is f "(x) = 12 x2, which is zero for x = 0, but x4 is strictly convex.

More generally, a continuous, twice differentiable function of several variables is convex on a convex set if and only if its Hessian matrix
Hessian matrix

In mathematics, the Hessian matrix is the square matrix of second-order partial derivatives of a function ; that is, it describes the local curvature of a function of many variables....
 is positive semidefinite
Positive-definite matrix

In linear algebra, a positive-definite matrix is a Hermitian matrix matrix which in many ways is analogous to a positive real number. The notion is closely related to a Definite bilinear form symmetric bilinear form ....
 on the interior of the convex set.

Any local minimum of a convex function is also a global minimum. A strictly convex function will have at most one global minimum.

For a convex function f, the sublevel sets and with a ? R are convex sets. However, a function whose sublevel sets are convex sets may fail to be a convex function; such a function is called a quasiconvex function
Quasiconvex function

In mathematics, a quasiconvex function is a real number-valued function defined on an interval or on a convex set of a real vector space such that the inverse image of any set of the form is a convex set....
.

Jensen's inequality
Jensen's inequality

In mathematics, Jensen's inequality, named after the Danish mathematician Johan Jensen, relates the value of a convex function of an integral to the integral of the convex function....
 applies to every convex function f. If is a random variable taking values in the domain of f, then (Here denotes the mathematical expectation.)

Convex function calculus

  • If and are convex functions, then so are and
  • If and are convex functions and if is increasing, then is convex.
  • Convexity is invariant under affine maps: that is, if is convex with , then so is , where
  • If is convex in and is a convex nonempty set, then is convex in provided for some


Examples

  • The function has at all points, so f is a (strictly) convex function.
  • The absolute value
    Absolute value

    In mathematics, the absolute value of a real number is its numerical value without regard to its Negative and non-negative numbers. So, for example, 3 is the absolute value of both 3 and -3....
     function is convex, even though it does not have a derivative at the point x = 0.
  • The function for 1 = p is convex.
  • The exponential function
    Exponential function

    The exponential function is a function in mathematics. The application of this function to a value x is written as exp. Equivalently, this can be written in the form ex, where e is the mathematical constant that is the base of the natural logarithm and that is also known as Euler's number....
      is convex. More generally, the function is logarithmically convex
    Logarithmically convex function

    In mathematics, a function defined on an convex set of a real numbers vector space and taking negative and positive numbers values is said to be logarithmically convex if is a convex function of ....
     if f is a convex function.
  • The function f with domain [0,1] defined by f(0)=f(1)=1, f(x)=0 for 0<x<1 is convex; it is continuous on the open interval (0,1), but not continuous at 0 and 1.
  • The function x3 has second derivative 6x; thus it is convex on the set where x = 0 and concave
    Concave function

    In mathematics, a concave function is the additive inverse of a convex function. A concave function is also synonymously called concave downwards, concave down, convex cap or upper convex....
     on the set where x = 0.
  • Every linear transformation
    Linear transformation

    In mathematics, a linear map is a function between two vector spaces that preserves the operations of vector addition and scalar multiplication....
     taking values in is convex but not strictly convex, since if f is linear, then This statement also holds if we replace "convex" by "concave".
  • Every affine function taking values in , i.e., each function of the form , is simultaneously convex and concave.
  • Every norm
    Norm (mathematics)

    In linear algebra, functional analysis and related areas of mathematics, a norm is a function that assigns a strictly positive length or size to all vectors in a vector space, other than the zero vector....
     is a convex function, by the triangle inequality
    Triangle inequality

    In mathematics, the triangle inequality states that for any triangle, the length of a given side must be less than the sum of the other two sides but greater than the difference between the two sides....
    .
  • If is convex, the perspective function is convex for
  • Examples of functions that are monotonically increasing
    Monotonic function

    In mathematics, a monotonic function is a function which preserves the given order. This concept first arose in calculus, and was later generalized to the more abstract setting of order theory....
     but not convex include and
  • Examples of functions that are convex but not monotonically increasing
    Monotonic function

    In mathematics, a monotonic function is a function which preserves the given order. This concept first arose in calculus, and was later generalized to the more abstract setting of order theory....
     include and .
  • The function f(x) = 1/x2, with f(0)=+8, is convex on the interval (0,+8) and convex on the interval (-8,0), but not convex on the interval (-8,+8), because of the singularity at x = 0.


See also

  • Convex optimization
    Convex optimization

    Convex optimization is a subfield of optimization . Given a real number vector space together with a convex function, real-valued function defined on a convex set of , the problem is to find the point in for which the number is smallest, i.e., the point such that for all ....
  • Geodesic convexity
    Geodesic convexity

    In mathematics — specifically, in Riemannian geometry — geodesic convexity is a natural generalization of convex set and convex function to Riemannian manifolds....
  • Kachurovskii's theorem
    Kachurovskii's theorem

    In mathematics, Kachurovskii's theorem is a theorem relating the convex function of a function on a Banach space to the monotone operator of its Fr?chet derivative....
    , which relates convexity to monotonicity of the derivative
  • Logarithmically convex function
    Logarithmically convex function

    In mathematics, a function defined on an convex set of a real numbers vector space and taking negative and positive numbers values is said to be logarithmically convex if is a convex function of ....
  • Quasiconvex function
    Quasiconvex function

    In mathematics, a quasiconvex function is a real number-valued function defined on an interval or on a convex set of a real vector space such that the inverse image of any set of the form is a convex set....
  • Subderivative
    Subderivative

    In mathematics, the concepts of subderivative, subgradient, and subdifferential arise in convex analysis, that is, in the study of convex functions, often in connection to convex optimization....
     of a convex function
  • Jensen's inequality
    Jensen's inequality

    In mathematics, Jensen's inequality, named after the Danish mathematician Johan Jensen, relates the value of a convex function of an integral to the integral of the convex function....
  • Hermite–Hadamard inequality
    Hermite–Hadamard inequality

    In mathematics, the Hermite?Hadarmard inequality, named after Charles Hermite and Jacques Hadamard and sometimes also called Hadamard's inequality, states that if a function ƒ : [ab] → R is convex function, then...


External links

  • Stephen Boyd and Lieven Vandenberghe, (PDF)
  • Jon Dattorro, (book pdf)