All Topics  
Asymptotic analysis

 

   Email Print
   Bookmark   Link






 

Asymptotic analysis



 
 
In pure
Pure mathematics

Broadly speaking, pure mathematics is mathematics motivated entirely for reasons other than application. It is distinguished by its Rigour#Mathematical_rigour, abstraction and mathematical beauty....
 and applied mathematics
Applied mathematics

Applied mathematics is a branch of mathematics that concerns itself with the mathematical techniques typically used in the application of mathematical knowledge to other domains....
, particularly the analysis of algorithms
Analysis of algorithms

To analyze an algorithm is to determine the amount of resources necessary to execute it. Most algorithms are designed to work with inputs of arbitrary length....
, real analysis, and engineering, asymptotic analysis is a method of describing limit
Limit (mathematics)

In mathematics, the concept of a "limit" is used to describe the behavior of a Function as its argument or input either "gets close" to some point, or as the argument becomes arbitrarily large; or the behavior of a sequence's elements as their index increases indefinitely....
ing behaviour. Similar limiting behaviour is sometimes expressed in the language of equivalence relation
Equivalence relation

In mathematics, an equivalence relation is, loosely, a binary relation on a Set that specifies how to split up the set into subsets such that every element of the larger set is in exactly one of the subsets....
s. Moreover, asymptotic analysis refers to solving problems approximately up to such equivalences. For example, given complex-valued functions f and g of a natural number variable n, one writes

to express the fact that

and and are called asymptotically equivalent as n → ∞.






Discussion
Ask a question about 'Asymptotic analysis'
Start a new discussion about 'Asymptotic analysis'
Answer questions from other users
Full Discussion Forum



Encyclopedia


In pure
Pure mathematics

Broadly speaking, pure mathematics is mathematics motivated entirely for reasons other than application. It is distinguished by its Rigour#Mathematical_rigour, abstraction and mathematical beauty....
 and applied mathematics
Applied mathematics

Applied mathematics is a branch of mathematics that concerns itself with the mathematical techniques typically used in the application of mathematical knowledge to other domains....
, particularly the analysis of algorithms
Analysis of algorithms

To analyze an algorithm is to determine the amount of resources necessary to execute it. Most algorithms are designed to work with inputs of arbitrary length....
, real analysis, and engineering, asymptotic analysis is a method of describing limit
Limit (mathematics)

In mathematics, the concept of a "limit" is used to describe the behavior of a Function as its argument or input either "gets close" to some point, or as the argument becomes arbitrarily large; or the behavior of a sequence's elements as their index increases indefinitely....
ing behaviour. Similar limiting behaviour is sometimes expressed in the language of equivalence relation
Equivalence relation

In mathematics, an equivalence relation is, loosely, a binary relation on a Set that specifies how to split up the set into subsets such that every element of the larger set is in exactly one of the subsets....
s. Moreover, asymptotic analysis refers to solving problems approximately up to such equivalences. For example, given complex-valued functions f and g of a natural number variable n, one writes

to express the fact that

and and are called asymptotically equivalent as n → ∞. This defines an equivalence relation (on the set of functions being nonzero for all n large enough - most mathematicians prefer the definition in terms of Landau notation, which avoids this restriction). The equivalence class of f consists of all functions g which "behave like" f, in the limit.

Asymptotic notation has been developed to provide a convenient language for the handling of statements about order of growth. It is also called Landau notation, since it became popular first in research in analytic number theory
Analytic number theory

In mathematics, analytic number theory is a branch of number theory that uses methods from mathematical analysis to solve number-theoretical problems....
, from about 1900 onwards, introduced by Edmund Landau
Edmund Landau

Edmund Georg Hermann Landau was a Germany Jewish mathematician and author of over 250 papers on number theory.Edmund Landau was born in Berlin to a wealthy Jewish family....
 (originated though by Paul Bachmann
Paul Bachmann

Paul Gustav Heinrich Bachmann was a Germany mathematician.Bachmann studied mathematics at the University of his native city of Berlin andreceived his doctorate in 1862 for his thesis on group theory....
). See also Big O notation
Big O notation

In mathematics, big O notation describes the asymptotic analysis of a function when the argument tends towards a particular value or infinity, usually in terms of simpler functions....
, for a treatment more from the point of view of analysis of algorithm
Algorithm

In mathematics, computing, linguistics and related subjects, an algorithm is a sequence of finite instructions, often used for calculation and data processing....
s. The asymptotic point of view is basic in computer science
Computer science

Computer science is the study of the theoretical foundations of information and computation, and of practical techniques for their implementation and application in computer systems....
, where the question is typically how to describe the resource implication of scaling-up the size of a computational problem, beyond the 'toy' level.

An asymptotic expansion
Asymptotic expansion

In mathematics an asymptotic expansion, asymptotic series or Poincar? expansion is a formal series of functions which has the property that truncating the series after a finite number of terms provides an approximation to a given function as the argument of the function tends towards a particular, often infinite, point....
 of a function f(x) is in practice an expression of that function in terms of a series
Series (mathematics)

In mathematics, given an infinite set sequence of numbers , a series is informally the result of adding all those terms together: . These can be written more compactly using the summation symbol ?....
, the partial sums of which do not necessarily converge, but such that taking any initial partial sum provides an asymptotic formula for f. The idea is that successive terms provide a more and more accurate description of the order of growth of f. An example is Stirling's approximation
Stirling's approximation

In mathematics, Stirling's approximation is an approximation for large factorials. It is named after James Stirling .The formula is written as...
.

In symbols, it means we have

but also

and

for each fixed k, while some limit is taken, usually with the requirement that gk+1 = o(gk), which means the (gk) form an asymptotic scale. The requirement that the successive sums improve the approximation may then be expressed as

In case the asymptotic expansion does not converge, for any particular value of the argument there will be a particular partial sum which provides the best approximation and adding additional terms will decrease the accuracy. However, this optimal partial sum will usually have more terms as the argument approaches the limit value.

Asymptotic expansions typically arise in the approximation of certain integrals (saddle-point method, method of steepest descent
Method of steepest descent

In mathematics, the steepest descent method or saddle-point approximation is a method used to approximate integrals of the formwhere f is some twice-Derivative function , M is a large number, and the integral endpoints a and b could possibly be infinite....
) or in the approximation of probability distributions (Edgeworth series
Edgeworth series

The Gram-Charlier A series and the Edgeworth series, named in honor of Francis Ysidro Edgeworth, are series_ that approximate a probability distribution in terms of its cumulants....
). The famous Feynman graphs in quantum field theory
Quantum field theory

Quantum field theory or QFT provides a theoretical framework for constructing quantum mechanics models of systems classically described by field or of Many-body problem....
 are another example of asymptotic expansions which often do not converge.

Use in Applied Mathematics


Asymptotic analysis is a key tool for exploring the ordinary
Ordinary differential equation

In mathematics, an ordinary differential equation is a relation that contains functions of only one independent variable, and one or more of its derivatives with respect to that variable....
 and partial
Partial differential equation

In mathematics, partial differential equations are a type of differential equation, i.e., a Relation involving an unknown Function of several independent variables and its partial derivatives with respect to those variables....
 differential equations which arise in the mathematical modelling
Mathematical model

A mathematical model uses mathematics language to describe a system. Mathematical models are used not only in the natural sciences and engineering disciplines but also in the social sciences ; physicists, engineers, computer sciences, and economists use mathematical models most extensively....
 of real-world phenomena. An illustrative example is the derivation of the boundary layer equations
Boundary layer

In physics and fluid mechanics, a boundary layer is that layer of fluid in the immediate vicinity of a bounding surface. In the Earth's atmosphere, the planetary boundary layer is the air layer near the ground affected by diurnal heat, moisture or momentum transfer to or from the surface....
 from the full Navier-Stokes equations
Navier-Stokes equations

The Navier?Stokes equations, named after Claude-Louis Navier and George Gabriel Stokes, describe the motion of fluid substances, that is substances which can flow....
 governing fluid flow. In many cases, the asymptotic expansion is in power of a small parameter, : in the boundary layer case, this is the nondimensional
Dimensional analysis

Dimensional analysis is a conceptual tool often applied in physics, chemistry, and engineering to understand physical situations involving certain physical quantities....
 ratio of the boundary layer thickness to a typical lengthscale of the problem. Indeed, applications of asymptotic analysis in mathematical modelling often centre around a nondimensional parameter which has been shown, or assumed, to be small through a consideration of the scales of the problem at hand.

Method of dominant balance

The method of dominant balance is used to determine the asymptotic behavior of solutions to an ODE
Ordinary differential equation

In mathematics, an ordinary differential equation is a relation that contains functions of only one independent variable, and one or more of its derivatives with respect to that variable....
 without solving it. The process is iterative in that the result obtained by performing the method once can be used as input when the method is repeated, to obtain as many terms in the asymptotic expansion as desired.

The process is as follows:

1. Assume that the asymptotic behavior has the form
.


2. Make a clever guess as to which terms in the ODE may be negligible in the limit we are interested in.

3. Drop those terms and solve the resulting ODE.

4. Check that the solution is consistent with step 2. If this is the case, then we have the controlling factor of the asymptotic behavior. Otherwise, we need to try dropping different terms in step 2.

5. Repeat the process using our result as the first term of the solution.

Example

Consider this second order ODE:


where c and a are arbitrary constants. This differential equation cannot be solved exactly. However, it may be useful to know how the solutions behave for large x.

We start by assuming as . We do this with the benefit of hindsight, to make things quicker. Since we only care about the behavior of y in the large x limit, we set y equal to , and re-express the ODE in terms of S(x):
, or




where we have used the product rule
Product rule

In calculus, the product rule is a formula used to find the derivatives of products of functions.It may be stated thus:or in the Leibniz notation thus:...
 and chain rule
Chain rule

In calculus, the chain rule is a formula for the derivative of the functional composition of two function .In intuitive terms, if a variable, y, depends on a second variable, u, which in turn depends on a third variable, x, then the rate of Mathematics#Change of y with respect to x can be computation as the rate of chan...
 to find the derivatives of y. Now let us suppose that a solution to this new ODE satisfies
as


as


We get the dominant asymptotic behaviour by setting
If satisfies the above asymptotic conditions, then everything is consistent. The terms we dropped will indeed have been negligible with respect to the ones we kept. is not a solution to the ODE for S, but it represents the dominant asymptotic behaviour, which is what we are interested in. Let us check that this choice for is consistent:




Everything is indeed consistent. Thus we find the dominant asymptotic behaviour of a solution to our ODE:


By convention, the asymptotic series is written as:
so to get at least the first term of this series we have to do another step to see if there is a power of x out the front.

We proceed by making an ansatz
Ansatz

Ansatz is a German noun with several meanings in the English language. The fact that the word Ansatz is found in the English language today suggests that it has been carried by those who have used it frequently,, such as mathematicians and physicists....
 that we can write
and then attempt to find asymptotic solutions for C(x). Substituting into the ODE for S(x) we find
Repeating the same process as before, we keep C' and (c-a)/x and find that
The leading asymptotic behaviour is therefore


See also

  • Asymptotic computational complexity
    Asymptotic computational complexity

    In computational complexity theory, asymptotic computational complexity is the usage of the asymptotic analysis for the estimation of computational complexity of algorithms and computational problems, commonly associated with the usage of the big O notation....