All Topics  
Spectral method

 

   Email Print
   Bookmark   Link






 

Spectral method



 
 
Spectral methods are a class of techniques used in applied mathematics
Applied mathematics

Applied mathematics is a branch of mathematics that concerns itself with the mathematical techniques typically used in the application of mathematical knowledge to other domains....
 and scientific computing to numerically solve certain partial differential equation
Partial differential equation

In mathematics, partial differential equations are a type of differential equation, i.e., a Relation involving an unknown Function of several independent variables and its partial derivatives with respect to those variables....
s (PDEs), often involving the use of the Fast Fourier Transform
Fast Fourier transform

A fast Fourier transform is an efficient algorithm to compute the discrete Fourier transform and its inverse. There are many distinct FFT algorithms involving a wide range of mathematics, from simple complex number to group theory and number theory; this article gives an overview of the available techniques and some of their general propert...
. Where applicable, spectral methods have excellent error properties, with the so called "exponential convergence" being the fastest possible.

PDEs describe a wide array of physical processes such as heat conduction, fluid flow, and sound propagation.






Discussion
Ask a question about 'Spectral method'
Start a new discussion about 'Spectral method'
Answer questions from other users
Full Discussion Forum



Encyclopedia


Spectral methods are a class of techniques used in applied mathematics
Applied mathematics

Applied mathematics is a branch of mathematics that concerns itself with the mathematical techniques typically used in the application of mathematical knowledge to other domains....
 and scientific computing to numerically solve certain partial differential equation
Partial differential equation

In mathematics, partial differential equations are a type of differential equation, i.e., a Relation involving an unknown Function of several independent variables and its partial derivatives with respect to those variables....
s (PDEs), often involving the use of the Fast Fourier Transform
Fast Fourier transform

A fast Fourier transform is an efficient algorithm to compute the discrete Fourier transform and its inverse. There are many distinct FFT algorithms involving a wide range of mathematics, from simple complex number to group theory and number theory; this article gives an overview of the available techniques and some of their general propert...
. Where applicable, spectral methods have excellent error properties, with the so called "exponential convergence" being the fastest possible.

PDEs describe a wide array of physical processes such as heat conduction, fluid flow, and sound propagation. In many such equations, there are underlying "basic waves" that can be used to give efficient algorithms for computing solutions to these PDEs. In a typical case, spectral methods take advantage of this fact by writing the solution as its Fourier series
Fourier series

In mathematics, a Fourier series decomposes a periodic function into a sum of simple oscillating functions, namely sine wave . The study of Fourier series is a branch of Fourier analysis....
, substituting this series into the PDE to get a system of ordinary differential equations (ODEs) in the time-dependent coefficients of the trigonometric terms in the series (written in complex exponential form), and using a time-stepping method to solve those ODEs.

The spectral method and the finite element method
Finite element method

The finite element method is a numerical analysis for finding approximate solutions of partial differential equations as well as of integral equations....
 are closely related and built on the same ideas; the main difference between them is that the spectral method approximates the solution as linear combination
Linear combination

In mathematics, linear combinations are a concept central to linear algebra and related fields of mathematics.Most of this article deals with linear combinations in the context of a vector space over a field , with some generalisations given at the end of the article....
 of continuous functions that are generally nonzero over the domain of solution (usually sinusoids or Chebyshev polynomials), while the finite element method approximates the solution as a linear combination of piecewise functions that are nonzero on small subdomains. Because of this, the spectral method takes on a global approach while the finite element method is a local approach. This is part of why the spectral method works best when the solution is smooth
Smooth function

In mathematical analysis, a differentiability class is a classification of function according to the properties of their derivatives. Higher order differentiability classes correspond to the existence of more derivatives....
.

In the finite element community, a method where the degree of the elements is very high or increases as the grid parameter h decreases to zero is sometimes called a spectral element method
Spectral element method

In mathematics, the spectral element method is a high order finite element method.Introduced in a 1984 paper by A. T. Patera, the abstract begins: "A spectral element method that combines the generality of the finite element method with the accuracy of spectral techniques..."...
.

The implementation of the spectral method is normally accomplished either with collocation
Collocation method

In mathematics, a collocation method is a method for the numerical analysis solution of ordinary differential equation and partial differential equations and integral equations....
 or a Galerkin
Galerkin method

In mathematics, in the area of numerical analysis, Galerkin methods are a class of methods for converting a continuous operator problem to a discrete problem....
 approach.

Examples of spectral methods


A concrete, linear example


Here we presume a basic understanding of basic multivariate calculus
Calculus

Calculus is a branch of mathematics that includes the study of limit , derivatives, integrals, and infinite series, and constitutes a major part of modern university education....
 and Fourier series
Fourier series

In mathematics, a Fourier series decomposes a periodic function into a sum of simple oscillating functions, namely sine wave . The study of Fourier series is a branch of Fourier analysis....
. If g(x,y) is a known, complex-valued function of two real variables, and g is periodic in x and y (that is, g(x,y)=g(x+2π,y)=g(x,y+2π)) then we are interested in finding a function f(x,y) so that

where the expression on the left denotes the second partial derivatives of f in x and y, respectively. This is the Poisson equation, and can be physically interpreted as some sort of heat conduction problem.

If we write f and g in Fourier series:

and substitute into the differential equation, we obtain this equation:

We have exchanged partial differentiation with an infinite sum, which is legitimate if we assume for instance that f has a continuous second derivative. By the uniqueness theorem for Fourier expansions, we must then equate the Fourier coefficients term by term, giving



which is an explicit formula for the Fourier coefficients aj,k.

To turn this into an algorithm, only finitely many frequencies are solved for. This introduces an error which can be shown to be proportional to , where and is the highest frequency treated.

Algorithm

  1. Compute the Fourier transform (bj,k) of g.
  2. Compute the Fourier transform (aj,k) of f via the formula (*) and the Fourier transform of g.
  3. Compute f by taking an inverse Fourier transform of (aj,k).


Since we're only interested in a finite window of frequencies (of size n, say) this can be done using a Fast Fourier Transform
Fast Fourier transform

A fast Fourier transform is an efficient algorithm to compute the discrete Fourier transform and its inverse. There are many distinct FFT algorithms involving a wide range of mathematics, from simple complex number to group theory and number theory; this article gives an overview of the available techniques and some of their general propert...
 algorithm. Therefore, globally the algorithm runs in time O(n log n).

A concrete, nonlinear example


We wish to solve the forced, transient, nonlinear Burgers' equation
Burgers' equation

Burgers' equation is a fundamental partial differential equation from fluid mechanics. It occurs in various areas of applied mathematics, such as modeling of gas dynamics and traffic flow....
 using a spectral approach.

Given on the periodic domain , find such that In weak, conservative form this becomes where following inner product
Inner product space

In mathematics, an inner product space is a vector space with the additional Mathematical structure of inner product. This additional structure associates each pair of vectors in the space with a Scalar quantity known as the inner product of the vectors....
 notation. Integrating by parts
Integration by parts

In calculus, and more generally in mathematical analysis, integration by parts is a rule that transforms the integral of products of functions into other, hopefully simpler, integrals....
 and using periodicity grants

To apply the Fourier-Galerkin method
Galerkin method

In mathematics, in the area of numerical analysis, Galerkin methods are a class of methods for converting a continuous operator problem to a discrete problem....
, choose both and where . This reduces the problem to finding such that

Using the orthogonality
Orthogonality

In mathematics, two vectors are orthogonal if they are perpendicular, i.e., they form a right angle. The word comes from the Greek language ' , meaning "straight", and ' , meaning "angle"....
 relation where is the Kronecker delta
Kronecker delta

In mathematics, the Kronecker delta or Kronecker's delta, named after Leopold Kronecker , is a Function of two variables, usually integers, which is 1 if they are equal, and 0 otherwise....
, we simplify the above three terms for each to see

Assemble the three terms for each to obtain

Dividing through by , we finally arrive at

With Fourier transformed initial conditions and forcing , this coupled system of ordinary differential equations may be integrated in time (using, e.g., a Runge Kutta technique) to find a solution. The nonlinear term is a convolution
Convolution

In mathematics and, in particular, functional analysis, convolution is a mathematical operator on two function s f and g, producing a third function that is typically viewed as a modified version of one of the original functions....
, and there are several transform-based techniques for evaluating it efficiently. See the references by Boyd and Canuto et al. for more details.

A relationship with the spectral element method


One can show that if is infinitely differentiable, then the numerical algorithm using Fast Fourier Transforms will converge faster than any polynomial in the grid size h. That is, for any n>0, there is a such that the error is less than for all sufficiently small values of . We say that the spectral method is of order , for every n>0.

Because a spectral element method
Spectral element method

In mathematics, the spectral element method is a high order finite element method.Introduced in a 1984 paper by A. T. Patera, the abstract begins: "A spectral element method that combines the generality of the finite element method with the accuracy of spectral techniques..."...
 is a finite element method
Finite element method

The finite element method is a numerical analysis for finding approximate solutions of partial differential equations as well as of integral equations....
 of very high order, there is a similarity in the convergence properties. However, whereas the spectral method is based on the eigendecomposition of the particular boundary value problem, the spectral element method does not use that information and works for arbitrary elliptic boundary value problem
Elliptic boundary value problem

In mathematics, an elliptic boundary value problem is a special kind of boundary value problem which can be thought of as the stable state of an evolution problem....
s.

See also

  • Discrete element method
    Discrete element method

    The term discrete element method is a family of numerical analysis methods for computing the motion of a large number of particles like molecules or grains of sand....
  • Gaussian grid
    Gaussian grid

    A Gaussian grid is used in the earth sciences as a grid graph for scientific modeling on a sphere . The grid is rectangular, with a set number of orthogonal coordinates , such that they can be easily accessed in a fixed array....
  • Pseudo-spectral method
    Pseudo-spectral method

    Pseudo-spectral methods are a class of numerical methods used in applied mathematics and scientific computing for the solution of PDEs, such as the direct simulation of a particle with an arbitrary wavefunction interacting with an arbitrary Potential energy....
  • Spectral element method
    Spectral element method

    In mathematics, the spectral element method is a high order finite element method.Introduced in a 1984 paper by A. T. Patera, the abstract begins: "A spectral element method that combines the generality of the finite element method with the accuracy of spectral techniques..."...
  • Galerkin method
    Galerkin method

    In mathematics, in the area of numerical analysis, Galerkin methods are a class of methods for converting a continuous operator problem to a discrete problem....
  • Collocation method
    Collocation method

    In mathematics, a collocation method is a method for the numerical analysis solution of ordinary differential equation and partial differential equations and integral equations....