All Topics  
Orthogonality

 

   Email Print
   Bookmark   Link






 

Orthogonality



 
 
In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, two vectors are orthogonal if they are perpendicular
Perpendicular

In geometry, two line or plane , are considered perpendicular to each other if they form congruence adjacent angles angles . The term may be used as a noun or adjective....
, i.e., they form a right angle. The word comes from the Greek
Greek language

Greek is an Indo-European languages native to the southern Balkan peninsula, the language of the Greek people. It forms an independent branch within Indo-European....
  (orthos), meaning "straight", and (gonia), meaning "angle". For example, a subway and the street above, although they do not physically intersect, are orthogonal if they cross at a right angle.

Definitions
Definition. Two vectors
Vector space

File:Vector addition ans scaling.pngA vector space is a mathematical structure formed by a collection of vectors: objects that may be Vector addition together and Scalar multiplication by numbers, called scalar s in this context....
  and in an inner product space
Inner product space

In mathematics, an inner product space is a vector space with the additional Mathematical structure of inner product. This additional structure associates each pair of vectors in the space with a Scalar quantity known as the inner product of the vectors....
  are orthogonal if their inner product is zero.






Discussion
Ask a question about 'Orthogonality'
Start a new discussion about 'Orthogonality'
Answer questions from other users
Full Discussion Forum



Encyclopedia


Perpendicular Coloured
In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, two vectors are orthogonal if they are perpendicular
Perpendicular

In geometry, two line or plane , are considered perpendicular to each other if they form congruence adjacent angles angles . The term may be used as a noun or adjective....
, i.e., they form a right angle. The word comes from the Greek
Greek language

Greek is an Indo-European languages native to the southern Balkan peninsula, the language of the Greek people. It forms an independent branch within Indo-European....
  (orthos), meaning "straight", and (gonia), meaning "angle". For example, a subway and the street above, although they do not physically intersect, are orthogonal if they cross at a right angle.

Definitions


Definition. Two vectors
Vector space

File:Vector addition ans scaling.pngA vector space is a mathematical structure formed by a collection of vectors: objects that may be Vector addition together and Scalar multiplication by numbers, called scalar s in this context....
  and in an inner product space
Inner product space

In mathematics, an inner product space is a vector space with the additional Mathematical structure of inner product. This additional structure associates each pair of vectors in the space with a Scalar quantity known as the inner product of the vectors....
  are orthogonal if their inner product is zero. This situation is denoted .

Definition. Two vector subspaces
Linear subspace

The concept of a linear subspace is important in linear algebra and related fields of mathematics.A linear subspace is usually called simply a subspace when the context serves to distinguish it from other kinds of subspaces....
  and of an inner product space are called orthogonal subspaces if each vector in is orthogonal to each vector in . The largest subspace that is orthogonal to a given subspace is its orthogonal complement
Orthogonal complement

In the mathematics fields of linear algebra and functional analysis, the orthogonal complement of a linear subspace W of an inner product space V is the set of all vectors in V that are orthogonal to every vector in W, i.e., it is...
.

Definition. A linear transformation
Linear transformation

In mathematics, a linear map is a function between two vector spaces that preserves the operations of vector addition and scalar multiplication....
  is called an orthogonal linear transformation if it preserves the inner product. That is, for all pairs of vectors and in the inner product space ,

This means that preserves the angle
Angle

In geometry and trigonometry, an angle is the figure formed by two Ray sharing a common endpoint, called the vertex of the angle . The magnitude of the angle is the "amount of rotation" that separates the two rays, and can be measured by considering the length of circular arc swept out when one ray is rotated about the vertex to coincide...
 between and , and that the length
Length

Length is the long dimension of any object. The length of a thing is the distance between its ends, its linear extent as measured from end to end....
s of and are equal.

A term rewriting system is said to be orthogonal
Orthogonality (term rewriting)

Orthogonality as a property of term rewriting systems describes where the reduction rules of the system are all left-linear, that is each variable occurs only once on the left hand side of each reduction rule, and there is no overlap between them....
 if it is left-linear and is non-ambiguous. Orthogonal term rewriting systems are confluent
Confluence (term rewriting)

Confluence is a property of rewriting, describing that terms in this system can be rewritten in more than one way, to yield the same result....
.

Several vectors are called pairwise orthogonal if any two of them are orthogonal, and a set of such vectors is called an orthogonal set. Non-zero pairwise orthogonal vectors are always linearly independent.

Note that the word normal is sometimes also used in place of orthogonal. However, normal can also refer to unit vectors. In particular, an orthogonal set is called orthonormal if all its vectors are unit vector
Unit vector

In mathematics, a unit vector in a normed vector space is a Vector space whose Norm is 1 . A unit vector is often denoted by a lowercase letter with a superscribed caret or ?hat?, like this: ....
s. So, using the term normal to mean "orthogonal" is often avoided.

In Euclidean vector spaces

In 2- or 3-dimension
Dimension

In mathematics, the dimension of a space is roughly defined as the minimum number of coordinates needed to specify every point within it. For example: a point on the unit circle in the plane can be specified by two Cartesian coordinates but one can make do with a single coordinate , so the circle is 1-dimensional even though it exists in...
al Euclidean space
Euclidean space

Around 300 Before Christ, the Ancient Greece mathematician Euclid undertook a study of relationships among distances and angles, first in a plane and then in space....
, two vectors are orthogonal if their dot product
Dot product

In mathematics, the dot product, also known as the scalar product, is an operation which takes two vector over the real numbers R and returns a real-valued scalar quantity....
 is zero, i.e. they make an angle of 90° or p/2 radian
Radian

The radian is a unit of plane angle, equal to 180/pi Degree , or about 57.2958 degrees, or about 57?17'45?. It is the standard unit of angular measurement in all areas of mathematics beyond the elementary level....
s. Hence orthogonality of vectors is a generalization of the concept of perpendicular
Perpendicular

In geometry, two line or plane , are considered perpendicular to each other if they form congruence adjacent angles angles . The term may be used as a noun or adjective....
. In terms of Euclidean subspace
Euclidean subspace

In linear algebra, a Euclidean subspace is a set of vector that is Closure under addition and scalar multiplication. Geometrically, a subspace is a flat in n-dimensional Euclidean space that passes through the origin....
s, the orthogonal complement of a line
Line

Line or lines may refer to:* Line , an infinitely-extending one-dimensional figure that has no curvature* Line , the fundamental unit of poetic composition...
 is the plane
Plane (mathematics)

In mathematics, a plane is a curvature surface. Planes can arise as subspaces of some higher dimensional space, as with the walls of a room, or they may enjoy an independent existence in their own right, as in the setting of Euclidean geometry....
 perpendicular to it, and vice versa. Note however that there is no correspondence with regards to perpendicular planes, because vectors in subspaces start from the origin
Origin (mathematics)

In mathematics, the origin of a Euclidean space is a special Point , usually denoted by the letter O, used as a fixed point of reference for the geometry of the surrounding space....
.

In 4-dimensional Euclidean space, the orthogonal complement of a line is a hyperplane
Hyperplane

A hyperplane is a concept in geometry. It is a higher-dimensional generalization of the concepts of a line in the plane and a plane in 3-dimensional space....
 and vice versa, and that of a plane is a plane.

Orthogonal functions

It is common to use the following inner product for two function
Function (mathematics)

The mathematical concept of a function expresses dependence between two quantities, one of which is known and the other which is produced. A function associates a single output to each input element drawn from a fixed Set , such as the real numbers , although different inputs may have the same output....
s f and g:

Here we introduce a nonnegative weight function
Weight function

A weight function is a mathematical device used when performing a sum, integral, or average in order to give some elements more of a "weight" than others....
  in the definition of this inner product.

We say that those functions are orthogonal if that inner product is zero:

We write the norm
Norm (mathematics)

In linear algebra, functional analysis and related areas of mathematics, a norm is a function that assigns a strictly positive length or size to all vectors in a vector space, other than the zero vector....
s with respect to this inner product and the weight function as

The members of a sequence are:
  • orthogonal if
  • orthonormal
where is the Kronecker delta
Kronecker delta

In mathematics, the Kronecker delta or Kronecker's delta, named after Leopold Kronecker , is a Function of two variables, usually integers, which is 1 if they are equal, and 0 otherwise....
. In other words, any two of them are orthogonal, and the norm of each is 1 in the case of the orthonormal sequence. See in particular orthogonal polynomials
Orthogonal polynomials

In mathematics, an orthogonal polynomial sequence is an infinite polynomial sequence of real number polynomialsof one variable x, in which each pn has degree n, and such that any two different polynomials in the sequence are orthogonality to each other under a particular version of the Lp space inner product....
.

Examples

  • The vectors (1, 3, 2), (3, −1, 0), (1/3, 1, −5/3) are orthogonal to each other, since (1)(3) + (3)(−1) + (2)(0) = 0, (3)(1/3) + (−1)(1) + (0)(−5/3) = 0, (1)(1/3) + (3)(1) − (2)(5/3) = 0. Observe also that the dot product of the vectors with themselves are the norms of those vectors, so to check for orthogonality, we need only check the dot product with every other vector.


  • The vectors (1, 0, 1, 0, ...)T and (0, 1, 0, 1, ...)T are orthogonal to each other. Clearly the dot product of these vectors is 0. We can then make the obvious generalization to consider the vectors in Z2n:




for some positive integer a, and for 1 = k = a − 1, these vectors are orthogonal, for example (1, 0, 0, 1, 0, 0, 1, 0)T, (0, 1, 0, 0, 1, 0, 0, 1)T, (0, 0, 1, 0, 0, 1, 0, 0)T are orthogonal.


  • Take two quadratic functions 2t + 3 and 5t2 + t − 17/9. These functions are orthogonal with respect to a unit weight function on the interval from −1 to 1. The product of these two functions is 10t3 + 17t2 − 7/9 t − 17/3, and now,








  • The functions 1, sin(nx), cos(nx) : n = 1, 2, 3, ... are orthogonal with respect to Lebesgue measure
    Lebesgue measure

    In mathematics, the Lebesgue measure, named after Henri Lebesgue, is the standard way of assigning a length, area or volume to subsets of Euclidean space....
     on the interval from 0 to 2p. This fact is basic in the theory of Fourier series
    Fourier series

    In mathematics, a Fourier series decomposes a periodic function into a sum of simple oscillating functions, namely sine wave . The study of Fourier series is a branch of Fourier analysis....
    .


  • Various eponymously named polynomial sequences are sequences of orthogonal polynomials
    Orthogonal polynomials

    In mathematics, an orthogonal polynomial sequence is an infinite polynomial sequence of real number polynomialsof one variable x, in which each pn has degree n, and such that any two different polynomials in the sequence are orthogonality to each other under a particular version of the Lp space inner product....
    . In particular:
    • The Hermite polynomials
      Hermite polynomials

      In mathematics, the Hermite polynomials are a classical orthogonal polynomial polynomial sequence that arise in probability, such as the Edgeworth series; in combinatorics, as an example of an Appell sequence, obeying the umbral calculus; and in physics, where they give rise to the eigenstates of the quantum harmonic oscillator....
       are orthogonal with respect to the normal distribution
      Normal distribution

      The normal distribution, also called the Gaussian distribution, is an important family of continuous probability distributions, applicable in many fields....
       with expected value 0.
    • The Legendre polynomials
      Legendre polynomials

      In mathematics, Legendre functions are solutions to Legendre's differential equation:They are named after Adrien-Marie Legendre. This differential equation is frequently encountered in physics and other technical fields....
       are orthogonal with respect to the uniform distribution
      Uniform distribution

      Uniform distribution can refer to:...
       on the interval from −1 to 1.
    • The Laguerre polynomials
      Laguerre polynomials

      In mathematics, the Laguerre polynomials, named after Edmond Laguerre ,are the canonical solutions of Laguerre's equation:which is a second-order linear differential equation....
       are orthogonal with respect to the exponential distribution
      Exponential distribution

      In probability theory and statistics, the exponential distributions are a class of continuous probability distributions. They describe the times between events in a Poisson process, i.e....
      . Somewhat more general Laguerre polynomial sequences are orthogonal with respect to gamma distribution
      Gamma distribution

      In probability theory and statistics, the gamma distribution is a two-parameter family of continuous probability distributions. It has a scale parameter θ and a shape parameter k....
      s.
    • The Chebyshev polynomials
      Chebyshev polynomials

      In mathematics the Chebyshev polynomials, named after Pafnuty Chebyshev, are a polynomial sequence of orthogonal polynomials which are related to de Moivre's formula and which are easily defined recursively, like Fibonacci numbers or Lucas numbers....
       of the first kind are orthogonal with respect to the measure
    • The Chebyshev polynomials of the second kind are orthogonal with respect to the Wigner semicircle distribution
      Wigner semicircle distribution

      The Wigner semicircle distribution, named after the physicist Eugene Wigner, is the probability distribution supported on the interval [−R, R] the graph of whose probability density function f is a semicircle of radius R centered at and then suitably normalizing constant :...
      .


  • In quantum mechanics
    Quantum mechanics

    Quantum mechanics is a set of principles underlying the most fundamental known description of all physical systems at the microscopic scale . Notable amongst these principles are both a dual wave-like and particle-like behavior of matter and radiation, and prediction of probabilities in situations where classical physics predicts certaintie...
    , two eigenstates of a wavefunction
    Wavefunction

    A wave function or wavefunction is a mathematical tool used in quantum mechanics to describe any physical system. It is a function from a mathematical space that maps the possible states of the system into the complex numbers....
    , and , are orthogonal if they correspond to different eigenvalues. This means, in Dirac notation, that unless and correspond to the same eigenvalue. This follows from the fact that Schrödinger's equation
    Schrödinger equation

    In physics, especially quantum mechanics, the Schr?dinger equation is an equation that describes how the quantum state of a physical system changes in time....
     is a Sturm–Liouville equation (in Schrödinger's formulation) or that observables are given by hermitian operators (in Heisenberg's formulation).


Derived meanings


Other meanings of the word orthogonal evolved from its earlier use in mathematics.

Art and architecture

In art the perspective
Perspective (graphical)

File:Staircase perspective.jpgPerspective in the graphic arts, such as drawing, is an approximate representation, on a flat surface , of an image as it is perceived by the eye....
 imagined lines pointing to the vanishing point
Vanishing point

A vanishing point is a point in a Perspective drawing to which parallel lines appear to converge. The number and placement of the vanishing points determines which perspective technique is being used....
 are referred to as 'orthogonal lines'.

The term "orthogonal line" often has a quite different meaning in the literature of modern art criticism. Many works by painters such as Piet Mondrian
Piet Mondrian

Pieter Cornelis Mondriaan, after 1912 Mondrian, , was a Dutch people Painting.He was an important contributor to the De Stijl art movement and group, which was founded by Theo van Doesburg....
 and Burgoyne Diller
Burgoyne Diller

Burgoyne A. Diller was an American abstract painter. Many of his best-known works are characterized by Orthogonal#Art_and_architecture geometric forms that reflect his strong interest in the De Stijl movement and the work of Piet Mondrian in particular....
 are noted for their exclusive use of "orthogonal lines" — not, however, with reference to perspective, but rather referring to lines which are straight and exclusively horizontal or vertical, forming right angles where they intersect. For example, an essay at the website of the Thyssen-Bornemisza Museum states that "Mondrian ....dedicated his entire oeuvre to the investigation of the balance between orthogonal lines and primary colours."

Computer science

Orthogonality is a system design property facilitating feasibility and compactness of complex designs. Orthogonality guarantees that modifying the technical effect produced by a component of a system neither creates nor propagates side effects to other components of the system. The emergent behavior of a system consisting of components should be controlled strictly by formal definitions of its logic and not by side effects resulting from poor integration, i.e. non-orthogonal design of modules and interfaces. Orthogonality reduces testing and development time because it is easier to verify designs that neither cause side effects nor depend on them.

For example, a car has orthogonal components and controls (e.g. accelerating the vehicle does not influence anything else but the components involved exclusively with the acceleration function). On the other hand, a non-orthogonal design might have its steering influence its braking (e.g. Electronic Stability Control
Electronic Stability Control

Electronic stability control is a computerized technology that improves the safety of a car handling by detecting and preventing skids. When ESC detects loss of steering control, ESC automatically applies individual brakes to help "steer" the vehicle where the driver wants to go....
), or its speed tweak its suspension. Consequently, this usage is seen to be derived from the use of orthogonal in mathematics: One may project a vector onto a subspace
Linear subspace

The concept of a linear subspace is important in linear algebra and related fields of mathematics.A linear subspace is usually called simply a subspace when the context serves to distinguish it from other kinds of subspaces....
 by projecting it onto each member of a set of basis vectors
Basis (linear algebra)

In linear algebra, a basis is a set of vectors that, in a linear combination, can represent every vector in a given vector space or free module, and such that no element of the set can be represented as a linear combination of the others....
 separately and adding the projections if and only if
If and only if

If and only if, in logic and fields that rely on it such as mathematics and philosophy, is a biconditional logical connective between statements....
 the basis vectors are mutually orthogonal.

An instruction set
Instruction set

An instruction set is a list of all the instruction , and all their variations, that a processor can execute.Instructions include:* Arithmetic such as add and subtract...
 is said to be orthogonal if any instruction can use any register
Processor register

In computer architecture, a processor register is a small amount of Computer storage available on the CPU whose contents can be accessed more quickly than storage available elsewhere....
 in any addressing mode
Addressing mode

Addressing modes are an aspect of the instruction set architecture in most central processing unit designs. The various addressing modes that are defined in a given instruction set architecture define how Machine code Instruction in that architecture identify the operand of each instruction....
. This terminology results from considering an instruction as a vector whose components are the instruction fields. One field identifies the registers to be operated upon, and another specifies the addressing mode. An orthogonal instruction set
Orthogonal instruction set

Orthogonal instruction set is a term used in computer engineering. A computer's instruction set is said to be orthogonal if any instruction can use data of any type via any addressing mode....
 uniquely encodes all combinations of registers and addressing modes.

Radio communications

In radio communications, multiple-access schemes are orthogonal when an ideal receiver can completely reject arbitrarily strong unwanted signals using different basis function
Basis function

In mathematics, particularly numerical analysis, a basis function is an element of the Basis for a function space. The term is a degeneration of the term basis vector for a more general vector space; that is, each function in the function space can be represented as a linear combination of the basis functions....
s than the desired signal. One such scheme is TDMA
Time division multiple access

Time division multiple access is a channel access method for shared medium networks. It allows several users to share the same frequency channel by dividing the signal into different time slots....
, where the orthogonal basis functions are non-overlapping rectangular pulses ("time slots").

Another scheme is orthogonal frequency-division multiplexing
Orthogonal frequency-division multiplexing

Orthogonal frequency-division multiplexing ? essentially identical to Coded OFDM and Discrete multi-tone modulation ? is a frequency-division multiplexing scheme utilized as a digital multi-carrier modulation method....
 (OFDM), which refers to the use, by a single transmitter, of a set of frequency multiplexed signals with the exact minimum frequency spacing needed to make them orthogonal so that they do not interfere with each other. Well known examples include (a and g) versions of 802.11 Wi-Fi
Wi-Fi

Wi-Fi is a trademark of the Wi-Fi Alliance, founded in 1999 as Wireless Internet Compatibility Alliance , comprising more than 300 companies, whose products are certified by the Wi-Fi Alliance, based on the IEEE 802.11 standards ....
; Wimax
WiMAX

File:WiMAX Antenne aufm Land.jpgFile:WiMAX equipment.jpgWiMAX, meaning Worldwide Inter-operability for Microwave Access, is a telecommunications technology that provides wireless Transmission of data using a variety of transmission modes, from Point-to-multipoint links to portable and fully mobile internet access....
; DVB-T
DVB-T

DVB-T is an abbreviation for Digital Video Broadcasting ?? Terrestrial; it is the Digital Video Broadcasting European-based consortium standard for the broadcast transmission of digital terrestrial television....
, the terrestrial digital TV broadcast system used in most of the world outside North America; and DMT, the standard form of ADSL.

Statistics, econometrics, and economics

When performing statistical analysis, variables that affect a particular result are said to be orthogonal if they are uncorrelated. That is to say that by varying each separately, one can predict the combined effect of varying them jointly. If correlation
Correlation

In probability theory and statistics, correlation indicates the strength and direction of a linear relationship between two random variables....
 is present, the factors are not orthogonal. In addition, orthogonality restrictions
Regression analysis

In statistics, regression analysis is a collective name for techniques for the modeling and analysis of numerical data consisting of values of a dependent variable and of one or more independent variables ....
 are necessary for inference. This meaning of orthogonality derives from the mathematical one, because orthogonal vectors are linearly independent.

Taxonomy

In taxonomy
Taxonomy

Taxonomy is the practice and science of classification. The word comes from the Greek language ', taxis and ', nomos .Taxonomies, or taxonomic schemes, are composed of taxonomic units known as taxa , or kinds of things that are arranged frequently in a hierarchical structure....
, an orthogonal classification is one in which no item is a member of more than one group, that is, the classifications are mutually exclusive.

Combinatorics

In combinatorics
Combinatorics

Combinatorics is a branch of pure mathematics concerning the study of Countable set objects. It is related to many other areas of mathematics, such as algebra, probability theory, ergodic theory and geometry, as well as to applied subjects in computer science and statistical physics....
, two n×n Latin squares are said to be orthogonal if their superimposition
Superimposition

In graphics, superimposition is the placement of an or video on top of an already-existing image or video, usually to add to the overall image effect, but also sometimes to conceal something ....
 yields all possible n2 combinations of entries.

Chemistry

In chemistry orthogonal protection is a strategy allowing the deprotection of functional groups independently of each other.

See also

  • orthogonalization
    Orthogonalization

    In linear algebra, orthogonalization is the process of finding a set of orthogonal vectors that span a particular linear subspace. Formally, starting with a linearly independent set of vectors in an inner product space , orthogonalization results in a set of Orthogonality vectors that generate the same subspace as the vectors v1<...
    • Gram–Schmidt process
      Gram–Schmidt process

      In mathematics, particularly linear algebra and numerical analysis, the Gram?Schmidt process is a method for orthogonalization a set of vector s in an inner product space, most commonly the Euclidean space Rn....
  • orthogonal complement
    Orthogonal complement

    In the mathematics fields of linear algebra and functional analysis, the orthogonal complement of a linear subspace W of an inner product space V is the set of all vectors in V that are orthogonal to every vector in W, i.e., it is...
  • orthonormality
    Orthonormality

    In linear algebra, two vector space in an inner product space are orthonormal if they are orthogonality and both of Unit vector length. A set of vectors form an orthonormal set if all vectors in the set are mutually orthogonal and all of unit length....
  • Pan-orthogonality occurs in coquaternion
    Coquaternion

    In abstract algebra, the split-quaternions or coquaternions are elements of an associative algebra introduced by James Cockle in 1849 under the latter name....
    s
  • orthonormal basis
    Orthonormal basis

    In mathematics, an orthonormal basis of an inner product space V , is a set of mutually orthogonality vectors of magnitude 1 that span the space when infinite linear combinations are allowed....
  • orthogonal polynomials
    Orthogonal polynomials

    In mathematics, an orthogonal polynomial sequence is an infinite polynomial sequence of real number polynomialsof one variable x, in which each pn has degree n, and such that any two different polynomials in the sequence are orthogonality to each other under a particular version of the Lp space inner product....
  • orthogonal matrix
    Orthogonal matrix

    In matrix theory, a real number orthogonal matrix is a Matrix #Square matrices Q whose transpose is its inverse matrix:A special orthogonal matrix is an orthogonal matrix with determinant +1:...
  • orthogonal group
    Orthogonal group

    In mathematics, the orthogonal group of degree n over a field F is the group of n-by-n orthogonal matrix with entries from F, with the group operation that of matrix multiplication....
  • surface normal
    Surface normal

    A surface normal, or simply normal, to a Flatness is a vector which is perpendicular to that surface. A normal to a non-flat surface at a Point P on the surface is a vector perpendicular to the Tangent space to that surface at P....


External links

  • in The Art of Unix Programming
    The Art of Unix Programming

    The Art of Unix Programming by Eric Raymond is a book about the history and culture of Unix programming from its earliest days in 1969 to now, covering both genetic derivations such as BSD and conceptual ones such as Linux....