All Topics  
Linear differential equation

 

   Email Print
   Bookmark   Link






 

Linear differential equation



 
 
In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, a linear differential equation is a differential equation
Differential equation

A differential equation is a mathematics equation for an unknown function of one or several variable that relates the values of the function itself and its derivatives of various orders....
 of the form



where the differential operator
Differential operator

In mathematics, a differential operator is an operator defined as a function of the derivative operator. It is helpful, as a matter of notation first, to consider differentiation as an abstract operation, accepting a function and returning another ....
 L is a linear operator, y is the unknown function, and the right hand side ƒ is a given function (called the source term). The linearity condition on L rules out operations such as taking the square of the derivative
Derivative

In calculus, a branch of mathematics, the derivative is a measure of how a function changes as its input changes. Loosely speaking, a derivative can be thought of as how much a quantity is changing at a given point....
 of y; but permits, for example, taking the second derivative of y.






Discussion
Ask a question about 'Linear differential equation'
Start a new discussion about 'Linear differential equation'
Answer questions from other users
Full Discussion Forum



Encyclopedia


In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, a linear differential equation is a differential equation
Differential equation

A differential equation is a mathematics equation for an unknown function of one or several variable that relates the values of the function itself and its derivatives of various orders....
 of the form



where the differential operator
Differential operator

In mathematics, a differential operator is an operator defined as a function of the derivative operator. It is helpful, as a matter of notation first, to consider differentiation as an abstract operation, accepting a function and returning another ....
 L is a linear operator, y is the unknown function, and the right hand side ƒ is a given function (called the source term). The linearity condition on L rules out operations such as taking the square of the derivative
Derivative

In calculus, a branch of mathematics, the derivative is a measure of how a function changes as its input changes. Loosely speaking, a derivative can be thought of as how much a quantity is changing at a given point....
 of y; but permits, for example, taking the second derivative of y. Therefore a fairly general form of such an equation would be



where D is the differential operator d/dx (i.e. Dy = y' , D2y = y",... ), and the ai are given functions. Such an equation is said to have order n, the index of the highest derivative of y that is involved. (Assuming a possibly existing coefficient an of this derivative to be non zero, it is eliminated by dividing through it. In case it can become zero, different cases must be considered separately for the analysis of the equation.)

If y is assumed to be a function of only one variable, one speaks about an ordinary differential equation
Ordinary differential equation

In mathematics, an ordinary differential equation is a relation that contains functions of only one independent variable, and one or more of its derivatives with respect to that variable....
, else the derivatives and their coefficients must be understood as (contracted
Tensor contraction

In multilinear algebra, a tensor contraction is an operation on one or more tensors that arises from the Bilinear form#different spaces of a finite-dimensional vector space and its dual vector space....
) vectors, matrices or tensor
Tensor

A tensor is an object which extends the notion of Scalar , Vector , and Matrix . The term has slightly different meanings in mathematics and physics....
s of higher rank, and we have a (linear) partial differential equation
Partial differential equation

In mathematics, partial differential equations are a type of differential equation, i.e., a Relation involving an unknown Function of several independent variables and its partial derivatives with respect to those variables....
.

The case where ƒ = 0 is called a homogeneous equation and its solutions are called complementary functions. It is particularly important to the solution of the general case, since any complementary function can be added to a solution of the inhomogeneous equation to give another solution (by a method traditionally called particular integral and complementary function). When the ai are numbers, the equation is said to have constant coefficients
Constant coefficients

In mathematics, constant coefficients is a term applied to differential operators, and also some difference operators, to signify that they contain no functions of the independent variables, other than constant functions....
.

Homogeneous equations with constant coefficients


The first method of solving linear ordinary differential equations with constant coefficients is due to Euler, who realized that solutions have the form , for possibly-complex values of . The exponential function is one of the few functions that keep its shape even after differentiation. In order for the sum of multiple derivatives of a function to sum up to zero, the derivatives must cancel each other out and the only way for them to do so is for the derivatives to have the same form as the initial function. Thus, to solve

we set , leading to

Division by e zx gives the nth-order polynomial

This equation F(z) = 0, is the "characteristic" equation considered later by Monge
Monge

Monge may refer to:*Gaspard Monge , mathematician and Conte de P?luse*Edgard Monge, ...
 and Cauchy.

Formally, the terms

of the original differential equation are replaced by zk. Solving
Root-finding algorithm

A root-finding algorithm is a numerical method, or algorithm, for finding a value x such that f = 0, for a given function f. Such an x is called a root of the function f....
 the polynomial gives n values of z, z1, ..., zn. Substitution of any of those values for z into e zx gives a solution e zix. Since homogeneous linear differential equations obey the superposition principle
Superposition principle

In physics and systems theory, the superposition principle, also known as superposition property, states that, for all linear systems,So that if input A produces response X and input B produces response Y then input produces response ....
, any linear combination
Linear combination

In mathematics, linear combinations are a concept central to linear algebra and related fields of mathematics.Most of this article deals with linear combinations in the context of a vector space over a field , with some generalisations given at the end of the article....
 of these functions also satisfies the differential equation.

When these roots are all distinct, we have n distinct solutions to the differential equation. It can be shown that these are linearly independent, by applying the Vandermonde determinant, and together they form a basis
Basis (linear algebra)

In linear algebra, a basis is a set of vectors that, in a linear combination, can represent every vector in a given vector space or free module, and such that no element of the set can be represented as a linear combination of the others....
 of the space of all solutions of the differential equation.

The preceding gave a solution for the case when all zeros are distinct, that is, each has multiplicity 1. For the general case, if z is a (possibly complex) zero
Root (mathematics)

In mathematics, a root of a complex-valued Function is a member of the Domain of such that vanishes at , that is,In other words, a "root" of a function is a value for that produces a result of zero ....
 (or root) of F(z) having multiplicity m, then, for , is a solution of the ODE. Applying this to all roots gives a collection of n distinct and linearly independent functions, where n is the degree of F(z). As before, these functions make up a basis of the solution space.

If the coefficients Ai of the differential equation are real, then real-valued solutions are generally preferable. Since non-real roots z then come in conjugate
Complex conjugate

In mathematics, the complex conjugate of a complex number is given by changing the sign of the imaginary part. Thus, the conjugate of the complex number...
 pairs, so do their corresponding basis functions , and the desired result is obtained by replacing each pair with their real-valued linear combination
Linear combination

In mathematics, linear combinations are a concept central to linear algebra and related fields of mathematics.Most of this article deals with linear combinations in the context of a vector space over a field , with some generalisations given at the end of the article....
s Re(y)
Real part

In mathematics, the real part of a complex number , is the first element of the ordered pair of real numbers representing , i.e. if , or equivalently, , then the real part of is ....
 and Im(y)
Imaginary part

In mathematics, the imaginary part of a complex number , is the second element of the ordered pair of real numbers representing i.e. if , or equivalently, , then the imaginary part of is ....
, where y is one of the pair.

A case that involves complex roots can be solved with the aid of Euler's formula
Euler's formula

Euler's formula, named after Leonhard Euler, is a mathematics formula in complex analysis that shows a deep relationship between the trigonometric functions and the complex exponential function....
.

Examples


Given . The characteristic equation is which has zeroes 2+i and 2-i. Thus the solution basis is . Now y is a solution if and only if
If and only if

If and only if, in logic and fields that rely on it such as mathematics and philosophy, is a biconditional logical connective between statements....
  for .

Because the coefficients are real,
  • we are likely not interested in the complex solutions
  • our basis elements are mutual conjugates
The linear combinations

and

will give us a real basis in .

Simple harmonic oscillator

The second order differential equation

which represents a simple harmonic oscillator
Harmonic oscillator

In classical mechanics, a harmonic oscillator is a system which, when displaced from its equilibrium position, experiences a restoring force proportional to the displacement according to Hooke's law:...
, can be restated as

The expression in parenthesis can be factored out, yielding

which has a pair of linearly independent solutions, one for

and another for

The solutions are, respectively,

and

These solutions provide a basis for the two-dimensional "solution space
Vector space

File:Vector addition ans scaling.pngA vector space is a mathematical structure formed by a collection of vectors: objects that may be Vector addition together and Scalar multiplication by numbers, called scalar s in this context....
" of the second order differential equation: meaning that linear combinations of these solutions will also be solutions. In particular, the following solutions can be constructed

and

These last two trigonometric solutions are linearly independent, so they can serve as another basis for the solution space, yielding the following general solution:
Damped harmonic oscillator
Given the equation for the damped harmonic oscillator
Harmonic oscillator

In classical mechanics, a harmonic oscillator is a system which, when displaced from its equilibrium position, experiences a restoring force proportional to the displacement according to Hooke's law:...
:

the expression in parentheses can be factored out: first obtain the characteristic equation by replacing D with λ. This equation must be satisfied for all y, thus:

Solve using the quadratic formula:

Use these data to factor out the original differential equation:

This implies a pair of solutions, one corresponding to

and another to

The solutions are, respectively,

and

where ω = b / 2m. From this linearly independent pair of solutions can be constructed another linearly independent pair which thus serve as a basis for the two-dimensional solution space:

However, if |ω| < |ω0| then it is preferable to get rid of the consequential imaginaries, expressing the general solution as

This latter solution corresponds to the underdamped case, whereas the former one corresponds to the overdamped case: the solutions for the underdamped case oscillate
Oscillation

Oscillation is the repetitive variation, typically in time, of some measure about a central value or between two or more different states. Familiar examples include a swinging pendulum and Alternating current power....
 whereas the solutions for the overdamped case do not.

Nonhomogeneous equation with constant coefficients


To obtain the solution to the non-homogeneous equation (sometimes called inhomogeneous equation), find a particular solution yP(x) by either the method of undetermined coefficients
Method of undetermined coefficients

In mathematics, the method of undetermined coefficients is an approach to finding a particular solution to certain inhomogeneous ordinary differential equations and recurrence relations....
 or the method of variation of parameters
Method of variation of parameters

In mathematics, variation of parameters also known as variation of constants, is a general method to solve inhomogeneous differential equation linear differential equation ordinary differential equations....
; the general solution to the linear differential equation is the sum of the general solution of the related homogeneous equation and the particular solution.

Suppose we face

For later convenience, define the characteristic polynomial

We find the solution basis as in the homogeneous (f=0) case. We now seek a particular solution yp by the variation of parameters method. Let the coefficients of the linear combination be functions of x:

Using the "operator" notation and a broad-minded use of notation, the ODE in question is ; so

With the constraints

the parameters commute out, with a little "dirt":

But , therefore

This, with the constraints, gives a linear system in the . This much can always be solved; in fact, combining Cramer's rule
Cramer's rule

Cramer's rule is a theorem in linear algebra, which gives the solution of a system of linear equations or corresponding square matrices in terms of determinants....
 with the Wronskian
Wronskian

In mathematics, the Wronskian is a function named after the Poland mathematician J?zef Maria Hoene-Wronski. It is especially important in the study of differential equations, where it can be used to determine whether a set of solutions is linear independence....
,

The rest is a matter of integrating

The particular solution is not unique; also satisfies the ODE for any set of constants cj.

Example

Suppose . We take the solution basis found above .
  
  
  


  
  


  
  


Using the list of integrals of exponential functions
List of integrals of exponential functions

The following is a list of integrals of exponential functions. For a complete list of Integral functions, please see the list of integrals.Note that x can be substituted for u, or any other variable, so long as the differential matches....


  
  


  
  


And so
  
  
(Notice that u1 and u2 had factors that canceled y1 and y2; that is typical.)

For interest's sake, this ODE has a physical interpretation as a driven damped harmonic oscillator
Harmonic oscillator

In classical mechanics, a harmonic oscillator is a system which, when displaced from its equilibrium position, experiences a restoring force proportional to the displacement according to Hooke's law:...
; yp represents the steady state, and is the transient.

Equation with variable coefficients


A linear ODE of order n with variable coefficients has the general form

Examples


A particular simple example is the Cauchy-Euler equation
Cauchy-Euler equation

In mathematics, a Cauchy-Euler equation is a linear differential equation homogeneous differential equation ordinary differential equation with variable coefficients....
 often used in engineering

First order equation


A linear ODE of order 1 with variable coefficients has the general form

Equations of this form can be solved by multiplying the integrating factor
Integrating factor

In mathematics, an integrating factor is a function that is chosen to facilitate the solving of a given ordinary differential equation....


throughout to obtain

which simplifies due to the product rule
Product rule

In calculus, the product rule is a formula used to find the derivatives of products of functions.It may be stated thus:or in the Leibniz notation thus:...
 to



which, on integrating both sides, yields





In other words: The solution of a first-order linear ODE



with coefficients that may or may not vary with x, is:

where ' is the constant of integration, and



Examples

Consider a first order differential equation with constant coefficients
Constant coefficients

In mathematics, constant coefficients is a term applied to differential operators, and also some difference operators, to signify that they contain no functions of the independent variables, other than constant functions....
:

This equation is particularly relevant to first order systems such as RC circuit
RC circuit

A 'resistor?capacitor circuit' , or 'RC filter' or 'RC network', is an electric circuit composed of resistors and capacitors driven by a voltage source or current source....
s and mass-damper
Damping

Damping is any effect, either deliberately engendered or inherent to a system, that tends to reduce the amplitude of oscillations of an oscillatory system....
 systems.

In this case, p(x) = b, r(x) = 1.

Hence its solution is

See also

  • Laplace transform
    Laplace transform

    In mathematics, the Laplace transform is one of the best known and most widely used integral transforms. It is commonly used to produce an easily solvable algebraic equation from an ordinary differential equation....
  • Fourier transform
    Fourier transform

    In mathematics, Fourier analysis is a subject area which grew out of the study of Fourier series. The subject began with trying to understand when it was possible to represent general functions by sums of simpler trigonometric functions....