All Topics  
Matrix (mathematics)

 

   Email Print
   Bookmark   Link






 

Matrix (mathematics)



 
 
In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, a matrix (plural matrices, or less commonly matrixes) is a rectangular array of number
Number

A number is a mathematical object used in counting and measurement. A notational symbol which represents a number is called a Numeral system, but in common usage the word number is used for both the abstract object and the symbol, as well as for the numeral for the number....
s, as shown at the right. In addition to a number of elementary, entrywise operations such as matrix addition
Matrix addition

In mathematics, matrix addition is the operation of adding two matrix by adding the corresponding entries together. However, there is another operation which could also be considered as a kind of addition for matrices....
 a key notion is matrix multiplication
Matrix multiplication

In mathematics, matrix multiplication is the operation of multiplying a matrix with either a scalar or another matrix. This article gives an overview of the various ways to perform matrix multiplication....
. The latter operation connects matrices to linear transformation
Linear transformation

In mathematics, a linear map is a function between two vector spaces that preserves the operations of vector addition and scalar multiplication....
s, i.e. higher-dimensional analogs of linear function
Linear function

In mathematics, the term linear function can refer to either of two different but related concepts: a first-degree polynomial function of one variable; or a map between two vector spaces that preserves vector addition and scalar multiplication....
s, i.e., functions of the form f(x) = c · x, where c is a constant. This map corresponds to a matrix with one row and column, with entry c.






Discussion
Ask a question about 'Matrix (mathematics)'
Start a new discussion about 'Matrix (mathematics)'
Answer questions from other users
Full Discussion Forum



Encyclopedia


In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, a matrix (plural matrices, or less commonly matrixes) is a rectangular array of number
Number

A number is a mathematical object used in counting and measurement. A notational symbol which represents a number is called a Numeral system, but in common usage the word number is used for both the abstract object and the symbol, as well as for the numeral for the number....
s, as shown at the right. In addition to a number of elementary, entrywise operations such as matrix addition
Matrix addition

In mathematics, matrix addition is the operation of adding two matrix by adding the corresponding entries together. However, there is another operation which could also be considered as a kind of addition for matrices....
 a key notion is matrix multiplication
Matrix multiplication

In mathematics, matrix multiplication is the operation of multiplying a matrix with either a scalar or another matrix. This article gives an overview of the various ways to perform matrix multiplication....
. The latter operation connects matrices to linear transformation
Linear transformation

In mathematics, a linear map is a function between two vector spaces that preserves the operations of vector addition and scalar multiplication....
s, i.e. higher-dimensional analogs of linear function
Linear function

In mathematics, the term linear function can refer to either of two different but related concepts: a first-degree polynomial function of one variable; or a map between two vector spaces that preserves vector addition and scalar multiplication....
s, i.e., functions of the form f(x) = c · x, where c is a constant. This map corresponds to a matrix with one row and column, with entry c. In general matrices are used to keep track of the coefficient
Coefficient

In mathematics, a coefficient is a constant multiplication factor of a certain object. For example, in the expression 9x2, the coefficient of x2 is 9....
s of linear equations
System of linear equations

In mathematics, a system of linear equations is a collection of linear equations involving the same set of variables. For example,is a system of three equations in the three variables ....
 and to record other data that depend on multiple parameters. This concept was also one of the historical roots of matrices.

In the particular case of square matrices, matrices with equal number of columns and rows, more refined data are attached to matrices, notably the determinant
Determinant

In algebra, a determinant is a function depending on n that associates a scalar , det, to an n?n square matrix A. The fundamental geometric meaning of a determinant is a scale factor for measure when A is regarded as a linear transformation....
, inverse matrices, which both govern solution properties of the system of linear equation belonging to the matrix, and eigenvalues and eigenvectors.

Matrices find many applications. Physics
Physics

Physics is the natural science which examines basic concepts such as energy, force, and spacetime and all that derives from these, such as mass, charge, matter and its Motion ....
 makes use of them in various domains, for example in geometrical optics
Geometrical optics

As a mathematical study, geometrical optics emerges as a short-wavelength limit for solutions to hyperbolic partial differential equations. For a less mathematical introduction, please see optics....
 and matrix mechanics
Matrix mechanics

Matrix mechanics is a formulation of quantum mechanics created by Werner Heisenberg, Max Born, and Pascual Jordan in 1925.Matrix mechanics was the first complete and correct definition of quantum mechanics....
. The latter also led to studying in more detail matrices with an infinite number of rows and columns. Matrices encoding distances of knot points in a graph
Graph (mathematics)

In mathematics a graph is an abstract representation of a set of objects where some pairs of the objects are connected by links. The interconnected objects are represented by mathematical abstractions called vertices, and the links that connect some pairs of vertices are called edges....
, such as cities connected by roads, are used in graph theory
Graph theory

In mathematics and computer science, graph theory is the study of graph : mathematical structures used to model pairwise relations between objects from a certain collection....
, and computer graphics
Computer graphics

Computer graphics are graphics created by computers and, more generally, the representation and manipulation of pictorial data by a computer....
 use matrices to encode projections of three-dimensional space onto a two-dimensional screen. Matrix calculus
Matrix calculus

In mathematics, matrix calculus is a specialized notation for doing multivariable calculus, especially over spaces of matrix , where it defines the matrix derivative....
 is generalizing classical analytical
Mathematical analysis

Mathematical analysis, which mathematicians refer to simply as analysis, has its beginnings in the rigorous formulation of calculus. It is the branch of mathematics most explicitly concerned with the notion of a limit , whether the limit of a sequence or the limit of a function....
 notions such as derivative
Derivative

In calculus, a branch of mathematics, the derivative is a measure of how a function changes as its input changes. Loosely speaking, a derivative can be thought of as how much a quantity is changing at a given point....
s of functions or exponentials to matrices. The latter is a recurring need in solving ordinary differential equation
Ordinary differential equation

In mathematics, an ordinary differential equation is a relation that contains functions of only one independent variable, and one or more of its derivatives with respect to that variable....
s.

Due to their widespread use, considerable effort has been made to develop efficient methods of matrix computing, particularly if the matrices are big. To this end, there are several matrix decomposition methods, which express matrices as products of other matrices, whose inverses, products etc. are easier to compute. Sparse matrices
Sparse matrix

In the mathematics subfield of numerical analysis a sparse matrix is a matrix populated primarily with zeros .Conceptually, sparsity corresponds to systems which are loosely coupled....
, matrices which have few non-zero entries, which occur, for example, in simulating mechanical experiments using the finite element method
Finite element method

The finite element method is a numerical analysis for finding approximate solutions of partial differential equations as well as of integral equations....
, often allow for more specifically tailored algorithms performing these tasks.

Matrices are described by the field of matrix theory
Matrix theory

Matrix theory is a branch of mathematics which focuses on the study of matrix . Initially a sub-branch of linear algebra, it has grown to cover subjects related to graph theory, algebra, combinatorics, and statistics as well....
. The close relationship of matrices with linear transformations makes the former a key notion of linear algebra
Linear algebra

Linear algebra is the branch of mathematics concerned with the study of Euclidean vectors, vector spaces , linear maps , and system of linear equations....
. Other types of entries, such as elements in more general mathematical fields
Field (mathematics)

In abstract algebra, a field is an algebraic structure with notions of addition, subtraction, multiplication and division , satisfying certain axioms....
 or even rings
Ring (mathematics)

In mathematics, a ring is a type of algebraic structure. There is some variation among mathematicians as to exactly what properties a ring is required to have, as described in detail below....
 are also used. Matrices consisting of only one column or row are called vector
Vector

Vector may refer to:...
s, while higher-dimensional, e.g. three-dimensional, arrays of numbers are called tensor
Tensor

A tensor is an object which extends the notion of Scalar , Vector , and Matrix . The term has slightly different meanings in mathematics and physics....
s.

Definition

A matrix is a rectangular arrangement of number
Number

A number is a mathematical object used in counting and measurement. A notational symbol which represents a number is called a Numeral system, but in common usage the word number is used for both the abstract object and the symbol, as well as for the numeral for the number....
s. For example,

alternatively denoted using parentheses
Bracket

Brackets are punctuation marks used in pairs to set apart or interject text within other text. In computer science, the term is sometimes said to strictly apply to the square or box type....
 instead of box brackets
Bracket

Brackets are punctuation marks used in pairs to set apart or interject text within other text. In computer science, the term is sometimes said to strictly apply to the square or box type....
:


The horizontal and vertical lines in a matrix are called rows and columns, respectively. The numbers in the matrix are called its entries. To specify a matrix' size, a matrix with m rows and n columns is called an m-by-n matrix or m × n matrix. Such a matrix has order m × n. m and n are called its dimensions. The above is a 4-by-3 matrix.

A matrix where one of the dimensions equals one is also called a vector
Vector

Vector may refer to:...
, and may be interpreted as an element of real coordinate space. An m × 1 matrix (one column and m rows) is called a column vector
Column vector

In linear algebra, a column vector or column matrix is an m × 1 matrix , i.e. a matrix consisting of a single column of elements....
 and a 1 × n matrix (one row and n columns) is called a row vector
Row vector

In linear algebra, a row vector or row matrix is a 1 × n matrix , that is, a matrix consisting of a single row:The transpose of a row vector is a column vector:...
. For example, the second row vector of the above matrix is

Most of this article focusses on real and complex matrices, i.e., matrices whose entries are real or complex numbers. More general types of entries are discussed below.

Notation

The entry that lies in the i-th row and the j-th column of a matrix is typically referred to as the i,j, (i,j), or (i,j)th entry of the matrix. For example, (2,3) entry of the above matrix X is 7.

Matrices are usually denoted using upper-case letters, while the corresponding lower-case letters, with two subscript indices, represent the entries. For example, the (i, j)th entry of a matrix A is most commonly written as ai,j. Alternative notations for that entry are A[i,j] or Ai,j. In addition to using upper-case letters to symbolize matrices, many authors use a special typographical style
Emphasis (typography)

In typography, emphasis is the exaggeration of words in a text with a font in a different style from the rest of the text—to emphasise them....
, commonly boldface upright (non-italic), to further distinguish matrices from other variables. An alternate convention is to annotate matrices with their dimensions in small type underneath the symbol, for example, for an m-by-n matrix. The set of all m-by-n matrices is denoted M(m, n).

A common shorthand is
A = [ai,j]i=1,...,m; j=1,...,n or more briefly A = [ai,j]m×n
to define an m × n matrix A. In this case, the entries ai,j are defined separately for all integers and ; for example the 2-by-2 matrix

is specified by A = [ij]i=1,2; j=1,2

Some programming languages start the numbering of rows and columns at zero, in which case the entries of an m-by-n matrix are indexed by and . This article will follow the numerotation starting from 1.

History

Matrices have a long history of application in solving linear equations. The Chinese text
Chinese mathematics

Mathematics in China emerged independently by the 11th century BC. The Chinese independently developed very large and negative numbers, decimals, a decimal system, a binary system, algebra, geometry, trigonometry....
 from between 300 BC and AD 200, The Nine Chapters on the Mathematical Art
The Nine Chapters on the Mathematical Art

The Nine Chapters on the Mathematical Art is a Chinese mathematics book, composed by several generations of scholars from the 10th–2nd century BC, and the latest stage being the 1st century AD....
 (Jiu Zhang Suan Shu), is the first example of the use of matrix methods to solve simultaneous equations
System of linear equations

In mathematics, a system of linear equations is a collection of linear equations involving the same set of variables. For example,is a system of three equations in the three variables ....
, including the concept of determinant
Determinant

In algebra, a determinant is a function depending on n that associates a scalar , det, to an n?n square matrix A. The fundamental geometric meaning of a determinant is a scale factor for measure when A is regarded as a linear transformation....
s, almost 2000 years before its publication by the Japanese
Japanese mathematics

In the history of mathematics, Japanese mathematics or wasan , denotes a genuinely distinct kind of mathematics developed in Japan during the Edo Period when the country was isolated from European influences....
 mathematician Seki Kowa in 1683 and the German mathematician Gottfried Leibniz
Gottfried Leibniz

Gottfried Wilhelm Leibniz was a Germany polymath who wrote primarily in Latin and French language.He occupies an equally grand place in both the history of philosophy and the history of mathematics....
 in 1693.

Magic square
Magic square

In recreational mathematics, a magic square of order n is an arrangement of n? numbers, usually distinct integers, in a square , such that the n numbers in all rows, all columns, and both diagonals sum to the same constant....
s were known to Chinese mathematicians, as early as 650 BC and Arab mathematicians
Islamic mathematics

Mathematics in medieval Islam or sometimes referred to as Islamic mathematics is a term used in the history of mathematics that refers to the mathematics developed in the Muslim world between 622 and 1600, in the part of the world where Islam was the dominant religion....
, possibly as early as the 7th century, when the Arab
Arab

An Arab is a person who Identity as such on linguistic or cultural grounds. The plural form, Arabs , refers to the Ethnocultural group at large....
s conquered northwestern parts of the Indian subcontinent
Indian subcontinent

The Indian subcontinent is a large section of the Asian continent consisting of the land lying substantially on the Indian Plate. The subcontinent includes parts of various countries in South Asia, including those on the continental crust , an Island#Continental islands country on the continental shelf , and an Island#Oceanic islands countr...
 and learned Indian mathematics
Indian mathematics

Indian mathematics—which here is the mathematics that emerged in South Asia from ancient times until the end of the 18th century—had its beginnings in the Bronze Age Indus Valley civilization and the Iron Age Vedic culture ....
 and astronomy, including other aspects of combinatorial mathematics. It has also been suggested that the idea came via China. The first magic squares of order 5 and 6 appear in an encyclopedia from Baghdad
Baghdad

Baghdad is the Capital of Iraq and of Baghdad Governorate, with which it is also coterminous. With a municipal population estimated at 6.5 million, it is the largest city in Iraq, and the second largest city in the Arab World....
 circa 983 AD, the Encyclopedia of the Brethren of Purity
Encyclopedia of the Brethren of Purity

The Encyclopedia of the Brethren of Purity was a large encyclopedia in 52 treatises written by the mysterious Brethren of Purity of Basra, Iraq sometime in the second half of the 900s Common Era ....
 (Rasa'il Ihkwan al-Safa); simpler magic squares were known to several earlier Arab mathematicians.

The modern matrix concept started with linear algebra
Linear algebra

Linear algebra is the branch of mathematics concerned with the study of Euclidean vectors, vector spaces , linear maps , and system of linear equations....
. Later, after the development of the theory of determinants by Seki Kowa and Leibniz in the late 17th century, Cramer
Gabriel Cramer

Gabriel Cramer was a Swiss mathematician, born in Geneva. He showed promise in mathematics from an early age. At 18 he received his doctorate and at 20 he was co-chair of mathematics....
 developed the theory further in the 18th century, presenting Cramer's rule
Cramer's rule

Cramer's rule is a theorem in linear algebra, which gives the solution of a system of linear equations or corresponding square matrices in terms of determinants....
 in 1750. Carl Friedrich Gauss
Carl Friedrich Gauss

Johann Carl Friedrich Gauss. was a Germans mathematician and scientist who contributed significantly to many fields, including number theory, statistics, mathematical analysis, Differential geometry and topology, geodesy, electrostatics, astronomy and optics....
 and Wilhelm Jordan
Wilhelm Jordan

Wilhelm Jordan was a Germany geodesist who did surveys in Germany and Africa and founded the German geodesy journal.Jordan was born in Ellwangen a small town in southern Germany....
 developed Gauss-Jordan elimination in the 1800s. The term "matrix" was coined in 1848 by J. J. Sylvester. Cayley
Arthur Cayley

Arthur Cayley was a British mathematician. He helped found the modern British school of pure mathematics.As a child, Cayley enjoyed solving complex maths problems for amusement....
, Hamilton
William Rowan Hamilton

Sir William Rowan Hamilton was an Ireland physicist, astronomer, and mathematician, who made important contributions to classical mechanics, optics, and algebra....
, Grassmann
Hermann Grassmann

Hermann G?nther Grassmann was a Germany polymath, renowned in his day as a linguistics and now admired as a mathematics. He was also a physics, Humanism, general scholar, and publisher....
, Frobenius
Ferdinand Georg Frobenius

Ferdinand Georg Frobenius was a Germany mathematician, best-known for his contributions to the theory of differential equations and to group theory....
 and von Neumann
John von Neumann

John von Neumann was a Hungarian American mathematician who made major contributions to a vast range of fields, including set theory, functional analysis, quantum mechanics, ergodic theory, continuous geometry, economics and game theory, computer science, numerical analysis, hydrodynamics , and statistics, as well as many other mathematical...
 are among the famous mathematicians who have worked on matrix theory
Matrix theory

Matrix theory is a branch of mathematics which focuses on the study of matrix . Initially a sub-branch of linear algebra, it has grown to cover subjects related to graph theory, algebra, combinatorics, and statistics as well....
.

Basic operations

There are a number of operations that can be applied to modify matrices called matrix addition, scalar multiplication and transposition. These form the basic techniques to deal with matrices.
Operation Definition Example
Addition The sum A+B of two m-by-n matrices A and B is calculated entrywise: i,j = Ai,j + Bi,j, where 1 ≤ im and 1 ≤ jn.
Scalar multiplication The scalar multiplication cA of a matrix A and a number c (also called a scalar
Scalar

A scalar is a variable that only has magnitude , e.g. a speed of 40 km/h. Compare it with vector, a quantity comprising both magnitude and Direction , e.g....
 in the parlance of abstract algebra
Abstract algebra

Abstract algebra is the subject area of mathematics that studies algebraic structures, such as group , ring , field , module , vector spaces, and algebra over a field....
) is given by multiplying every entry of
A by c:
(cA)i,j = c · Ai,j.
Transpose The transpose of an m-by-n matrix A is the n-by-m matrix AT (also denoted Atr or tA) formed by turning rows into columns and vice versa:
(AT)i,j = Aj,i.


Familiar properties of numbers extend to these operations of matrices: for example, addition is commutative, i.e. the matrix sum does not depend on the order of the summands: A + B = B + A. The transpose, which does not exist for numbers, is compatible with addition and scalar multiplication, as expressed by (cA)T = c(AT) and (A + B)T = AT + BT. Finally, (AT)T = A.

Matrix multiplication, linear equations and linear transformations

Multiplication of two matrices is defined only if the number of columns of the left matrix is the same as the number of rows of the right matrix. If A is an m-by-n matrix and B is an n-by-p matrix, then their matrix product AB is the m-by-p matrix whose entries are given by



where 1 =
i = m and 1 = j = p. For example (the highlighted entry 1 in the product is calculated as the product 1 · 1 + 0 · 1 + 2 · 0 = 1):



Matrix multiplication satisfies the rules (
AB)C = A(BC) (associativity
Associativity

In mathematics, associativity is a property that a binary operation can have. It means that, within an expression containing two or more of the same associative operators in a row, the order that the operations are performed does not matter as long as the sequence of the operands is not changed....
), and (
A+B)C = AC+BC as well as C(A+B) = CA+CB (left and right distributivity
Distributivity

In mathematics, and in particular in abstract algebra, distributivity is a property of binary operations that generalises the distributive law from elementary algebra....
), whenever the size of the matrices is such that the various products are defined. The product
AB may be defined without BA being defined, namely if A and B are
m-by-n and n-by-k matrices, respectively, and Even if both products are defined, they need not be equal, i.e. generally one has
ABBA,
i.e. matrix multiplication is not commutative
Commutativity

In mathematics, commutativity is the process to change the order of something without changing the end result. It is a fundamental property of many binary operations throughout mathematics, and many Mathematical proof depend on it....
, in marked contrast to (rational, real, or complex) numbers whose product is independent of the order of the factors. An example for two matrices not commuting with each other is: , whereas

The identity matrix
Identity matrix

In linear algebra, the identity matrix or unit matrix of size n is the n-by-n square matrix with ones on the main diagonal and zeros elsewhere....
 
I
n of size n is the n-by-n matrix in which all the elements on the main diagonal
Main diagonal

In linear algebra, the main diagonal of a matrix is the collection of cells where is equal to .The main diagonal of a square matrix is the diagonal which runs from the top left corner to the bottom right corner....
 are equal to 1 and all other elements are equal to 0, e.g.
It is called identity matrix because multiplication with it leaves a matrix unchanged:
MIn = ImM = M for any m-by-n matrix M.

Besides the ordinary matrix multiplication just described, there exist other less frequently used operations on matrices that can be considered forms of multiplication, such as the Hadamard product
Matrix multiplication

In mathematics, matrix multiplication is the operation of multiplying a matrix with either a scalar or another matrix. This article gives an overview of the various ways to perform matrix multiplication....
 and the Kronecker product
Kronecker product

In mathematics, the Kronecker product, denoted by , is an operation on two matrix of arbitrary size resulting in a block matrix. It is a special case of a tensor product....
.

Linear equations

A particular case of matrix multiplication is tightly linked to
linear equations: if x designates a column vector (i.e. n×1-matrix) of n variables x1, x2, ..., xn, and A is an m-by-n matrix, then the matrix equation
Ax = b, where b is some m×1-column vector
is equivalent to the system of linear equations
A1,1x1 + A1,2x2 + ... + A1,nxn = b1
...
Am,1x1 + Am,2x2 + ... + Am,nxn = bm
This way, matrices can be used to compactly write and deal with multiple linear equations, i.e. systems of linear equations.

Linear transformations

Matrices and matrix multiplication reveal their essential features when related to
linear transformations (or linear maps). Any m-by-n matrix
A gives rise to a linear transformation Rn ? Rm, by assigning to any vector x in Rn the (matrix) product Ax, which is an element in Rm. Conversely, given any linear transformation, there exists a unique matrix A, such that the transformation is given by this formula: its ai,j is given by the i-th component of f(ej), where ej = (0, ..., 0, 1, 0, ..., 0) is the unit vector
Unit vector

In mathematics, a unit vector in a normed vector space is a Vector space whose Norm is 1 . A unit vector is often denoted by a lowercase letter with a superscribed caret or ?hat?, like this: ....
 with 1 at the
j-th spot and 0 elsewhere. The matrix
A is said to represent the linear map f, and A is called the transformation matrix of f.

The following table shows a number of 2-by-2 matrices
Real matrices (2 x 2)

The 2 x 2 real matrices are the linear mappings of the Cartesian coordinate system into itself by the ruleThe set of all such real matrices is denoted by M....
 with the associated linear maps of
R2. The blue original is mapped to the green grid and shapes, the origin (0, 0) is marked with a black point.
Vertical shear with m=1.25. Horizontal flip
Flip

Flip may refer to:* Flip , a mathematical operation* Flip , a class of mixed drink* Flip , a colloquial term referring to Filipino people* Flip , a character from the comic strip and cartoon Little Nemo...
Squeeze mapping
Squeeze mapping

In linear algebra, a squeeze mapping is a type of linear map that preserves Euclidean area of regions in the Cartesian plane, but is not a Euclidean motion....
 with r=1.5
Scaling
Scaling

Scaling may refer to:* Scaling , a linear transformation that enlarges or diminishes objects* Scaling , a network's ability to function as the number of people or computers on the network increases....
 by a factor of 1.5
Rotation
Rotation matrix

In matrix theory, a rotation matrix is a real number square matrix whose transpose is its invertible matrix and whose determinant is 1 The matrix is so-called because it geometrically corresponds to a linear map that sends vectors to a corresponding vector rotated about the origin by a fixed angle....
 by p/6 = 30°
  


Under the 1-to-1 correspondence
Bijection

In mathematics, a bijection, or a bijective function is a function f from a set X to a set Y with the property that, for every y in Y, there is exactly one x in X such that f = y....
 of matrices and linear maps, matrix multiplication corresponds to composition
Function composition

In mathematics, a composite function represents the application of one function to the results of another. For instance, the functions and can be composed by first computing a f and then applying a function g to the output of f....
 of maps: if a
k-by-m matrix B represents another linear map g : Rm ? Rk, then the composition is represented by BA since (x) = g(f(x)) = g(Ax) = B(Ax) = (BA)x. The last equality follows from the above-mentioned associativity of matrix multiplication.

The nullity and rank of a matrix
A are the dimension of the kernel and image
Image (mathematics)

In mathematics, the image of a set under a given function is the set of all possible function outputs when taking each element of the set, successively, as the function's argument....
 of the linear map represented by
A, respectively. The rank is also characterized as the number of linear independent
Linear independence

In linear algebra, a family of vector spaces is linearly independent if none of them can be written as a linear combination of finitely many other vectors in the collection....
 row vectors of the matrix, which is the same as the number of linear independent column vectors. The sum of the nullity and rank equals the number of columns of the matrix, by the rank-nullity theorem
Rank-nullity theorem

In mathematics, the rank?nullity theorem of linear algebra, in its simplest form, states that the rank and the nullity of a matrix add up to the number of columns of the matrix....
.

Square matrices

A
square matrix is a matrix which has the same number of rows and columns. Due to this size restriction, all matrices can be multiplied (and added). A n-by-n matrix, also known as a square matrix of order n, A, is called invertible
Invertible matrix

In linear algebra, an n-by-n matrix A is called invertible or non-singular if there exists an n-by-n matrix B such that...
or non-singular if there exists a matrix
B such that
AB = In.
This is equivalent to BA = In. Moreover, if B exists, it is unique and is called the inverse matrix of A, denoted A−1.

The entries A
i,i form the main diagonal
Main diagonal

In linear algebra, the main diagonal of a matrix is the collection of cells where is equal to .The main diagonal of a square matrix is the diagonal which runs from the top left corner to the bottom right corner....
 of a matrix. If all entries outside the main diagonal are zero,
A is called diagonal matrix
Diagonal matrix

In linear algebra, a diagonal matrix is a square matrix in which the entries outside the main diagonal are all zero. The diagonal entries themselves may or may not be zero....
. If only all entries above (below) the main diagonal are zero,
A is called a lower triangular matrix (upper triangular matrix, respectively). For example, if
n = 3, they look like

(diagonal), (lower) and (upper triangular matrix).

Determinant


The
determinant det(
A) or |A| of a square matrix A is a number encoding certain properties of the matrix. A matrix is invertible if and only if
If and only if

If and only if, in logic and fields that rely on it such as mathematics and philosophy, is a biconditional logical connective between statements....
 its determinant is nonzero. Its absolute value
Absolute value

In mathematics, the absolute value of a real number is its numerical value without regard to its Negative and non-negative numbers. So, for example, 3 is the absolute value of both 3 and -3....
 equals the area (in
R2) or volume (in R3) of the image of the unit square (or cube), while its sign corresponds to the orientation of the corresponding linear map: the determinant is positive if and only if the orientation is preserved.

The determinant of 2-by-2 matrices is given by , the determinant of 3-by-3 matrices involves 6 terms (rule of Sarrus
Rule of Sarrus

Sarrus' rule or Sarrus' scheme is a method and a memorization scheme to compute the determinant of a 3×3 matrix. It is named after the French mathematician Pierre Fr?d?ric Sarrus....
). The more lengthy Leibniz formula generalises these two formulae to all dimensions.

The determinant of a product of matrices equals the product of the determinants: det(
AB) = det(A) · det(B). Adding multiples of rows or columns to other rows or columns does not change the determinant. Exchanging rows or columns alters the sign of the determinant. Using these two operations, any matrix can be transformed to a lower (or upper) triangular matrix, whose determinant equals the product of the entries on the main diagonal; therefore the determinant of the original matrix can be calculated. Finally, the Laplace expansion
Laplace expansion

In linear algebra, the Laplace expansion of the determinant ofan n × n square Matrix B expresses the determinant |B| as a sum of n determinants of  ×  sub-matrices of B....
 expresses the determinant in terms of minors
Minor (linear algebra)

In linear algebra, a minor of a matrix A is the determinant of some smaller square matrix, cut down from A by removing one or more of its rows or columns....
, i.e., determinants of smaller matrices. Determinants can be used to solve linear system
Linear system

A linear system is a mathematical model of a system based on the use of a linear operator.Linear systems typically exhibit features and properties that are much simpler than the general, nonlinear case....
s using Cramer's rule
Cramer's rule

Cramer's rule is a theorem in linear algebra, which gives the solution of a system of linear equations or corresponding square matrices in terms of determinants....
, where the division of the determinants of two related square matrices equates to the value of each of the system's variables.

Eigenvalues and eigenvectors

A number ? and a non-zero vector
v satisfying
Av = ?v
are called
eigenvalue and eigenvector of A, respectively.Eigen means "own" in German
German language

German is a West Germanic languages, thus related to and classified alongside English language and Dutch language. It is one of the world's world language and the most widely spoken mother tongue in the European Union....
 and in Dutch
Dutch language

Dutch is a West Germanic languages spoken by over 22 million people as a first language, and about 5 million people as a second language."1% of the EU population claims to speak Dutch well enough in order to have a conversation." Outside the European Union the number of second language speakers of Dutch is very small. Most native...
. The number ? is an eigenvalue of
A if and only if A-?In is not invertible, which is equivalent
Logical equivalence

In logic, statements p and q are logically equivalent if they have the same logical content.Syntax , p and q are equivalent if each can be proof from the other....
 to
det(A-?I) = 0.
The function
pA(t) = det(A-t
I) is called the characteristic polynomial
Characteristic polynomial

In linear algebra, one associates a polynomial to every square matrix, its characteristic polynomial. This polynomial encodes several important properties of the matrix , most notably its eigenvalues, its determinant and its Trace ....
 of A, the degree of this polynomial
Degree of a polynomial

When a polynomial is expressed as a sum or difference of term s , the exponent of the term with the highest exponent is the degree of the polynomial....
 is n. Therefore pA(t) has at most n (possibly complex) different roots, i.e. eigenvalues of the matrix.

The trace of a square matrix is the sum of its diagonal entries. It equals the sum of its n eigenvalues.

Definiteness

Matrix A; definiteness; associated bilinear form BA(v), v = (x, y);
set of vectors v such that BA(v)
positive definite indefinite
1/4 x2 + y2 1/4 x2 − 1/4 y2

Ellipse
Ellipse

In mathematics, an ellipse is the apparent shape of a circle viewed obliquely from outside it, as distinct from a hyperbola which is the shape seen from inside....
 

Hyperbola
Hyperbola

In mathematics a hyperbola is a smooth function planar curve having two connected components or branches, each a mirror image of the other and resembling two infinite bow aimed at each other....


A square matrix A that is is equal to its transpose, i.e. A = AT, is a symmetric matrix
Symmetric matrix

In linear algebra, a symmetric matrix is a square matrix, A, that is equal to its transposeThe entries of a symmetric matrix are symmetric with respect to the main diagonal ....
; if it is equal to the negative of its transpose, i.e. A = −AT, then it is a skew-symmetric matrix
Skew-symmetric matrix

In linear algebra, a skew-symmetric matrix is a square matrix A whose transpose is also its negative; that is, it satisfies the equation:...
. A symmetric n×n-matrix is called positive definite
Positive definite

In mathematics, positive definite may refer to:* positive-definite matrix* positive-definite function** positive definite function on a group...
 (negative definite, indefinite, resp.), if for all nonzero vectors x ? Rn the associated quadratic form
Quadratic form

In mathematics, a quadratic form is a homogeneous polynomial of Degree_ two in a number of variables. For example,is a quadratic form in the variables x and y....
 given by
Q(x) = xTAx
takes only positive values (negative, both negative and positive values, respectively). Allowing as input two different vectors instead yields the bilinear form
Bilinear form

In mathematics, a bilinear form on a vector space V is a bilinear mapping V ? V ? F, where F is the field of scalars....
 associated to A:
BA (x, y) = xTAy.
A matrix is positive definite if and only if all its eigenvalues are positive. Definiteness can also be defined for complex Hermitian matrices
Hermitian matrix

A Hermitian matrix is a square matrix with complex number entries which is equal to its own conjugate transpose — that is, the element in the ith row and jth column is equal to the complex conjugate of the element in the jth row and ith column, for all indices i and j:...
, which satisfy A* = A, where the star denotes the conjugate transpose
Conjugate transpose

In mathematics, the conjugate transpose, Hermitian transpose, or adjoint matrix of an m-by-n matrix A with complex number entries is the n-by-m matrix A* obtained from A by taking the transpose and then taking the complex conjugate of each entry....
 of the matrix, i.e. the transpose of the complex conjugate
Complex conjugate

In mathematics, the complex conjugate of a complex number is given by changing the sign of the imaginary part. Thus, the conjugate of the complex number...
 of A. The table at the right shows two possibilities for 2-by-2 matrices.

By the spectral theorem
Spectral theorem

In mathematics, particularly linear algebra and functional analysis, the spectral theorem is any of a number of results about linear operators or about matrix_....
, positive definite matrices have an eigenbasis, i.e. every vector is expressible as a linear combination
Linear combination

In mathematics, linear combinations are a concept central to linear algebra and related fields of mathematics.Most of this article deals with linear combinations in the context of a vector space over a field , with some generalisations given at the end of the article....
 of eigenvectors. Also, all eigenvalues are real.

Computational aspects

In addition to theoretical knowledge of properties of matrices and their relation to other fields, it is important for practical purposes to perform matrix calculations effectively and precisely. The domain studying these matters is called numerical linear algebra
Numerical linear algebra

Numerical linear algebra is the study of algorithms for performing linear algebra computations, most notably Matrix operations, on computers. It is often a fundamental part of engineering and computational science problems, such as and signal processing, computational finance, materials science simulations, structural biology, data mining,...
.

An important point is the performance of algorithm
Algorithm

In mathematics, computing, linguistics and related subjects, an algorithm is a sequence of finite instructions, often used for calculation and data processing....
s, i.e. upper bound
Upper bound

In mathematics, especially in order theory, an upper bound of a subset S of some partially ordered set is an element of P which is greater than or equal to every element of S....
s or estimations of how many elementary operations such as additions and multiplications of scalars are necessary to perform some operation on matrices. For example, calculating the matrix product of two n-by-n matrix using the definition given above needs n3 multiplications, since for any of the n2 entries of the product, n multiplications are necessary. The Strassen algorithm
Strassen algorithm

In the mathematics discipline of linear algebra, the Strassen algorithm, named after Volker Strassen, is an algorithm used for matrix multiplication....
 outperforms this "naive" algorithm; it needs only n2.807 multiplications. A refined approach also incorporates specific features of the computing devices.

Another issue is numerical stability
Numerical stability

In the mathematics subfield of numerical analysis, numerical stability is a desirable property of numerical algorithms. The precise definition of stability depends on the context, but it is related to the accuracy of the algorithm....
. For example, calculating the inverse of a matrix via Laplace's formula (Adj (A) denotes the adjugate matrix
Adjugate matrix

In linear algebra, the adjugate or classical adjoint of a square matrix is a matrix which plays a role similar to the invertible matrix; it can however be defined for any square matrix without the need to perform any divisions....
 of A)
A−1 = Adj(A) / det(A)
may lead to significant rounding errors if the determinant of the matrix is very small. The norm of a matrix
Matrix norm

In mathematics, a matrix norm is a natural extension of the notion of a vector norm to matrix ....
 can be used to capture the conditioning
Conditioning

Conditioning may refer to:* In probability theory, the use of conditional probabilities, expectations and distributions; see conditioning * In mathematics, the property of a matrix as "well-conditioned" or "ill-conditioned"; see condition number...
 of linear algebraic problems, such as computing a matrix' inverse.

In many practical situations additional information about the matrices involved is known. An important case are sparse matrices
Sparse matrix

In the mathematics subfield of numerical analysis a sparse matrix is a matrix populated primarily with zeros .Conceptually, sparsity corresponds to systems which are loosely coupled....
, i.e. matrices most of whose entries are zero. There are specifically adapted algorithms for, say, solving linear systems Ax = b for sparse matrices A, such as the conjugate gradient method
Conjugate gradient method

In mathematics, the conjugate gradient method is an algorithm for the numerical solution of particular system of linear equations, namely those whose matrix is symmetric matrix and positive-definite matrix....
. It can be implemented both directly or iteratively, i.e. finding a sequence of vectors xn converging to a solution of the equation when n tends to infinity
Infinity

Infinity comes from the Latin infinitas or "unboundedness." It refers to several distinct concepts – usually linked to the idea of "without end" – which arise in philosophy, mathematics, and theology....
.

Although most computer languages are not designed with commands or libraries for matrices, as early as the 1970s, some engineering desktop computers such as the HP 9830
HP 9830

The HP 9800 was a family of what were initially called programmable calculators and later desktop computers made by Hewlett-Packard which replaced their first HP 9100 calculator....
 had ROM cartridges to add BASIC commands for matrices. Some computer languages such as APL were designed to manipulate matrices, and various mathematical programs
List of numerical analysis software

Listed here are a number of computer programs used for performing numerical analysis calculations:* ADMB is a software suite for non-linear statistical modeling based on C++ which uses automatic differentiation....
 can be used to aid computing with matrices.

Matrix decomposition methods

There are several methods to render matrices into a more easily accessible form. They are generally referred to as matrix transformation or matrix decomposition techniques. The interest of all these decomposition techniques is that they preserve certain properties of the matrices in question, such as determinant, rank or inverse, so that these quantities can be calculated after applying the transformation, or that certain matrix operations are algorithmically easier to carry out for some types of matrices.

The LU decomposition
LU decomposition

In linear algebra, the LU decomposition is a matrix decomposition which writes a matrix as the product of a lower triangular matrix and an upper triangular matrix....
 factors matrices as a product of lower (L) and an upper triangular matrices (U). Once this decomposition is calculated, linear systems can be solved more efficiently, by a simple technique called forward and back substitution. Likewise, inverses of triangular matrices are algorithmically easier to calculate. The Gaussian elimination
Gaussian elimination

In linear algebra, Gaussian elimination is an efficient algorithm for solving system of linear equations, finding the Rank of a matrix , and calculating the inverse of an invertible matrix....
 is a similar algorithm; it transforms any matrix to row echelon form
Row echelon form

In linear algebra a matrix is in row echelon form if* All nonzero rows are above any rows of all zeroes, and* The leading coefficient of a row is always strictly to the right of the leading coefficient of the row above it....
. Both methods proceed by multiplying the matrix by suitable elementary matrices, which correspond to permuting rows or columns
Permutation matrix

In mathematics, in matrix theory, a permutation matrix is a square -matrix that has exactly one entry 1 in each row and each column and 0's elsewhere....
 and adding multiples of one row to another row.

The eigendecomposition expresses A as a product VDV−1, where D is a diagonal matrix and V is a suitable invertible matrix. If A can be written in this form, it is called diagonalizable
Diagonalizable matrix

In linear algebra, a square matrix A is called diagonalizable if it is similar matrix to a diagonal matrix, i.e. if there exists an invertible matrix P such that P −1AP is a diagonal matrix....
. More generally, and applicable to all matrices, the Jordan decomposition
Jordan decomposition

In mathematics, Jordan decomposition may refer to* Hahn decomposition theorem, and the Jordan decomposition of a measure* Jordan normal form of a matrix...
 transforms a matrix into Jordan normal form
Jordan normal form

In linear algebra, Jordan normal form shows that a given square matrix M over a field K containing the eigenvalues of M can be transformed into a certain normal form by changing the Basis ....
. Given the eigendecomposition, the nth power of A (i.e. n-fold iterated matrix multiplication) can be calculated via
An = (VDV−1)n = VDV−1VDV−1...VDV−1 = VDnV−1
and the power of a diagonal matrix can be calculated by taking the corresponding powers of the diagonal entries, which is much easier than doing the exponentiation for A instead. This can be used to compute the matrix exponential
Matrix exponential

In mathematics, the matrix exponential is a matrix function on square matrix analogous to the ordinary exponential function. Abstractly, the matrix exponential gives the connection between a matrix Lie algebra and the corresponding Lie group....
 eA, a need frequently arising in solving linear differential equation
Linear differential equation

In mathematics, a linear differential equation is a differential equation of the formwhere the differential operator L is a linear operator, y is the unknown function, and the right hand side ƒ is a given function ....
s, matrix logarithms and square roots of matrices
Square root of a matrix

In mathematics, the square root of a matrix extends the notion of square root from numbers to Matrix ....
. To avoid numerically ill-conditioned
Condition number

In numerical analysis, the condition number associated with a problem is a measure of that problem's amenability to digital computation, that is, how numerically well-conditioned the problem is....
 situations, further algorithms such as the Schur decomposition
Schur decomposition

In the mathematics discipline of linear algebra, the Schur decomposition or Schur triangulation, named after Issai Schur, is an important matrix decomposition....
 can be employed.

The QR decomposition
QR decomposition

In linear algebra, the QR decomposition of a matrix is a matrix decomposition of the matrix into an orthogonal matrix and a right triangular matrix....
 expresses a matrix as the product of an orthogonal matrix and a upper triangular matrix. It can be used for the QR algorithm
QR algorithm

In numerical linear algebra, the QR algorithm is an eigenvalue algorithm; that is, a procedure to calculate the Eigenvalue, eigenvector and eigenspace of a Matrix ....
, one of several algorithms computing the eigenvalues
Eigenvalue algorithm

In linear algebra, one of the most important problems is designing efficient and Numerical stability algorithms for finding the eigenvalues of a Matrix ....
 of a matrix.

Abstract algebraic aspects


Matrices with more general entries

This article focuses on matrices whose entries are real or complex number
Complex number

In mathematics, the complex numbers are an extension of the real numbers obtained by adjoining an imaginary unit, denoted i, which satisfies:...
s. However, matrices can be considered with much more general types of entries than real or complex numbers. As a first step of generalization, any field
Field (mathematics)

In abstract algebra, a field is an algebraic structure with notions of addition, subtraction, multiplication and division , satisfying certain axioms....
, i.e. a set where addition
Addition

Addition is the mathematics process of putting things together. The plus sign "+" means that numbers are added together. For example, in the picture on the right, there are 3 + 2 apples?meaning three apples and two other apples?which is the same as five apples, since 3 + 2 = 5....
, subtraction
Subtraction

Subtraction is one of the four basic arithmetic operations; it is the inverse of addition, meaning that if we start with any number and add any number and then subtract the same number we added, we return to the number we started with....
, multiplication
Multiplication

Multiplication is the Operation of scaling one number by another. It is one of the four basic operations in elementary arithmetic .Multiplication is defined for Natural number in terms of repeated addition; for example, 4 multiplied by 3 can be calculated by adding 3 copies of 4 together:...
 and division
Division (mathematics)

In mathematics, especially in elementary arithmetic, division is an arithmetic operation which is the inverse of multiplication.Specifically, if c times b equals a, written:...
 operations are defined and well-behaved, may be used instead of R or C, for example rational number
Rational number

In mathematics, a rational number is a number which can be expressed as a quotient of two integers. Non-integer rational numbers are usually written as the vulgar fraction , where b is not 0 ....
s or finite field
Finite field

In abstract algebra, a finite field or Galois field is a field that contains only finitely many elements. Finite fields are important in number theory, algebraic geometry, Galois theory, cryptography, and coding theory....
s. Wherever eigenvalues are considered, the choice of the field usually matters insofar as a the characteristic polynomial
Characteristic polynomial

In linear algebra, one associates a polynomial to every square matrix, its characteristic polynomial. This polynomial encodes several important properties of the matrix , most notably its eigenvalues, its determinant and its Trace ....
, despite having real coefficients may have complex solutions. Therefore, the field is often required to be C or any algebraically closed field
Algebraically closed field

In mathematics, a field F is said to be algebraically closed if every polynomial in one variable of degree at least 1, with coefficients in F, has a root in F....
 when such issues arise.

More generally, abstract algebra makes great use of matrices with entries in a ring
Ring (mathematics)

In mathematics, a ring is a type of algebraic structure. There is some variation among mathematicians as to exactly what properties a ring is required to have, as described in detail below....
 R. Rings are a more general notion than fields in that no division operation exists. The very same addition and multiplication operations of matrices extend to this setting, too. The set M(n, R) of all square n-by-n matrices over R is a ring in its own right, isomorphic to the endomorphism ring
Endomorphism ring

In abstract algebra, one associates to certain objects a ring , the object's endomorphism ring, which encodes several internal properties of the object....
 of the left R-module
Module (mathematics)

In abstract algebra, the concept of a module over a ring is a generalization of the notion of vector space, where instead of requiring the scalar to lie in a field , the "scalars" may lie in an arbitrary ring....
 Rn. If the ring R is commutative
Commutative ring

In ring theory, a branch of abstract algebra, a commutative ring is a Ring in which the multiplication operation is commutative. The study of commutative rings is called commutative algebra....
, i.e., its multiplication is commutative, then M(n, R) is a unitary noncommutative (unless n = 1) associative algebra
Associative algebra

In mathematics, an associative algebra is a vector space which also allows the multiplication of vectors in a distributivity and associativity manner....
 over R. The determinant
Determinant

In algebra, a determinant is a function depending on n that associates a scalar , det, to an n?n square matrix A. The fundamental geometric meaning of a determinant is a scale factor for measure when A is regarded as a linear transformation....
 of square matrices can still be defined using the Leibniz formula
Leibniz formula (determinant)

In algebra, the Leibniz formula expresses the determinant of a square matrix in terms of permutations of the matrix' elements. Named in honor of Gottfried Leibniz, the formula is...
; a matrix is invertible if and only if its determinant is invertible in R, generalising the situation over a field F, where every nonzero element is invertible. Matrices over superrings are called supermatrices
Supermatrix

In mathematics and theoretical physics, a supermatrix is a Z2-graded analog of an ordinary matrix . Specifically, a supermatrix is a 2×2 block matrix with entries in a superalgebra ....
.

Relationship to linear maps

Linear maps Rn ? Rm are equivalent to n-by-m matrices, as described above. More generally, any linear map between finite-dimensional vector space
Vector space

File:Vector addition ans scaling.pngA vector space is a mathematical structure formed by a collection of vectors: objects that may be Vector addition together and Scalar multiplication by numbers, called scalar s in this context....
s can be described by a matrix A = (aij), by choosing bases
Basis (linear algebra)

In linear algebra, a basis is a set of vectors that, in a linear combination, can represent every vector in a given vector space or free module, and such that no element of the set can be represented as a linear combination of the others....
 v1, ..., vm, and w1, ..., wn, where m and n are the dimensions of V and W, respectively, and requiring . This uniquely determines the entries of the matrix A, but the matrix depends on the choice of the bases: different choices of bases give rise to different, but similar matrices
Similar matrix

In linear algebra, two n-by-n matrix A and B are called similar iffor some invertible matrix n-by-n matrix P. Similar matrices represent the same linear map under two different Basis , with P being the change of basis matrix....
. Many of the above concrete notions can be reinterpreted in this light, for example, the transpose matrix AT describes the transpose of the linear map
Dual space

In mathematics, any vector space, V, has a corresponding dual vector space consisting of all linear functionals on V. Dual vector spaces defined on finite-dimensional vector spaces can be used for defining tensors which are studied in tensor algebra....
 given by A, with respect to the dual bases
Dual space

In mathematics, any vector space, V, has a corresponding dual vector space consisting of all linear functionals on V. Dual vector spaces defined on finite-dimensional vector spaces can be used for defining tensors which are studied in tensor algebra....
.

Infinite matrices

It is also possible to consider matrices with infinitely many rows and/or columns. The basic operations introduced above are defined the same way in this case. Matrix multiplication, however, and all operations stemming therefrom are only meaningful when restricted to certain matrices, since the sum featuring in the above definition of the matrix product will contain an infinity of summands. An easy way to circumvent this issue is to restrict to matrices all of whose rows (or columns) contain only finitely many nonzero terms. More generally, one can impose convergence
Convergence

In the absence of a more specific context, convergence denotes the approach toward a definite value, as time goes on; or to a definite point, a common view or opinion, or toward a fixed or equilibrium point state....
 restrictions on the entries of the matrices involved. The explicit point of view of matrices tends to obfuscate the matter, and the abstract and more powerful tools of functional analysis
Functional analysis

Functional analysis is the branch of mathematics, and specifically of mathematical analysis, concerned with the study of vector spaces and operators acting upon them....
 are used instead, by relating matrices to linear maps (as in the finite case above), but imposing additional convergence and continuity
Continuity

Continuity may refer to:In mathematics:* Continuous probability distribution or random variable in probability and statistics* For functions:...
 constraints.

Tensors

A vector can be seen as a sequence of numbers, a matrix is a rectangular or two-dimensional array of numbers. Extending this leads to tensor
Tensor

A tensor is an object which extends the notion of Scalar , Vector , and Matrix . The term has slightly different meanings in mathematics and physics....
s which can be seen as higher-dimensional arrays of numbers.

Matrix groups

A group
Group (mathematics)

In mathematics, a group is an algebraic structure consisting of a set together with an Binary operation that combines any two of its element to form a third element....
 is a mathematical structure consisting of a set of objects together with a binary operation
Binary operation

In mathematics, a binary operation is a calculation involving two operands, in other words, an operation whose arity is two. Binary operations can be accomplished using either a binary function or binary operator....
, i.e. an operation combining any two objects to a third, subject to certain requirements. A group in which the objects are matrices and the group operation is matrix multiplication is called a matrix group.Additionally, the group is required to be closed in the general linear group. Since in a group every element has to be invertible, the most general matrix groups are the groups of all invertible matrices of a given size, called the general linear group
General linear group

In mathematics, the general linear group of degree n is the set of n×n invertible matrix, together with the operation of ordinary matrix multiplication....
s.

Any property of matrices that is preserved under matrix products and inverses can be used to define further matrix groups. For example, matrices with a given size and with a determinant of 1 form a subgroup
Subgroup

In group theory, given a group G under a binary operation *, we say that some subset H of G is a subgroup of G if H also forms a group under the operation *....
 of (i.e. a smaller group contained in) their general linear group, called a special linear group
Special linear group

In mathematics, the special linear group of degree n over a field F is the set of n×n Matrix with determinant 1, with the group operations of ordinary matrix multiplication and matrix inversion....
. Orthogonal matrices
Orthogonal matrix

In matrix theory, a real number orthogonal matrix is a Matrix #Square matrices Q whose transpose is its inverse matrix:A special orthogonal matrix is an orthogonal matrix with determinant +1:...
, determined by the condition
MTM = I
form the orthogonal group
Orthogonal group

In mathematics, the orthogonal group of degree n over a field F is the group of n-by-n orthogonal matrix with entries from F, with the group operation that of matrix multiplication....
. They are called orthogonal since the associated linear transformations of Rn preserve angles in the sense that the scalar product of two vectors is unchanged after applying M to them: · (Mw) = v · w. Every finite group is isomorphic to a matrix group. General groups can be studied using matrix groups, which are comparatively well-understood, by means of representation theory
Representation theory

Representation theory is a branch of mathematics that studies abstract algebra algebraic structures by representing their element as linear transformations of vector spaces....
.

Applications

There are numerous applications of matrices, both in mathematics and other sciences. Some of them merely take advantage of the compact representation of a set of numbers in a matrix. For example, in game theory
Game theory

Game theory is a branch of applied mathematics that is used in the social sciences , biology, engineering, political science, international relations, computer science , and philosophy....
, the payoff matrix encodes the payoff for two players, depending on which out of a given (finite) set of alternatives the players choose. Text mining
Text mining

Text mining, sometimes alternately referred to as text data mining, roughly equivalent to text analytics, refers generally to the process of deriving high-quality information from text....
 and automatated thesaurus
Thesaurus

A thesaurus is a work that contains synonyms and sometimes antonyms, in contrast to a dictionary, which contains definitions and pronunciations....
 compilation makes use of document-term matrices
Document-term matrix

Document-term matrices are used in natural language processing programs. They represent natural language documents as mathematical objects and make it possible to process them as a whole....
 such as tf-idf in order to keep track of frequencies of certain words in several documents.

Complex numbers can be represented by particular real 2-by-2 matrices via , under which addition and multiplication of complex numbers and matrices correspond to each other. For example, 2-by-2 rotation matrices represent the multiplication with some complex number of absolute value
Absolute value

In mathematics, the absolute value of a real number is its numerical value without regard to its Negative and non-negative numbers. So, for example, 3 is the absolute value of both 3 and -3....
 1, as above. A similar interpretation is possible for quaternion
Quaternion

Quaternions, in mathematics, are a non-commutative number system that extends the complex numbers. The quaternions were first described by Irish mathematician Sir William Rowan Hamilton in 1843 and applied to mechanics in three-dimensional space....
s.

Matrices over a polynomial ring
Polynomial ring

In mathematics, especially in the field of abstract algebra, a polynomial ring is a ring formed from the Set of polynomials in one or more variables with coefficients in a ring ....
 are important in the study of control theory
Control theory

Control theory is an interdisciplinary branch of engineering and mathematics, that deals with the behavior of dynamical systems. The desired output of a system is called the reference....
.

Early encryption
Encryption

In cryptography, encryption is the process of transforming information using an algorithm to make it unreadable to anyone except those possessing special knowledge, usually referred to as a key ....
 techniques such as the Hill cipher
Hill cipher

In classical cryptography, the Hill cipher is a substitution cipher#Polygraphic based on linear algebra. Invented by Lester S. Hill in 1929, it was the first polygraphic cipher in which it was practical to operate on more than three symbols at once....
 also used matrices. However, due to the linear nature of matrices, these codes are comparatively easy to break. Computer graphics
Computer graphics

Computer graphics are graphics created by computers and, more generally, the representation and manipulation of pictorial data by a computer....
 uses matrices both to respresent objects and to calculate transformations of objects using affine rotation matrices
Rotation matrix

In matrix theory, a rotation matrix is a real number square matrix whose transpose is its invertible matrix and whose determinant is 1 The matrix is so-called because it geometrically corresponds to a linear map that sends vectors to a corresponding vector rotated about the origin by a fixed angle....
 to accomplish tasks such as projecting a three-dimensional object onto a two-dimensional screen, corresponding to a theoretical camera observation.

Graph theory

The adjacency matrix
Adjacency matrix

In mathematics and computer science, the adjacency matrix of a finite set directed or undirected graph G on n vertices is the n × n matrix where the nondiagonal entry is the number of edges from vertex i to vertex j, and the diagonal entry is either twice the number of loops at vertex i or just the number o...
 of a finite graph is a basic notion of graph theory
Graph theory

In mathematics and computer science, graph theory is the study of graph : mathematical structures used to model pairwise relations between objects from a certain collection....
. It saves which vertices of the graph are connected by an edge. Matrices containing just two different values (0 and 1 meaning for example "yes" and "no") are called logical matrices
Logical matrix

A logical matrix or Boolean matrix is a matrix with entries from the Boolean domain B = . Such a matrix can be used to represent a binary relation between a pair of finite sets....
. The distance (or cost) matrix
Distance matrix

In mathematics, a distance matrix is a matrix containing the distances, taken pairwise, of a set of points. It is therefore a symmetric N×N matrix containing non-negative reals as elements, given N points in Euclidean space....
 contains information about distances of the edges. These concepts can be applied to website
Website

A Web site is a collection of related Web pages, images, videos or other digital assets that are hosted on one Web server, usually accessible via the Internet....
s connected hyperlink
Hyperlink

In computing, a hyperlink, usually shortened to link, is a directly followable reference within a hypertext document.The area from which the hyperlink can be activated is called its anchor; its target is what the link points to, which may be another location within the same page or document, another page or document, or a...
s or cities connected by roads etc., in which case (unless the road network is extremely dense) the matrices tend to be sparse
Sparse matrix

In the mathematics subfield of numerical analysis a sparse matrix is a matrix populated primarily with zeros .Conceptually, sparsity corresponds to systems which are loosely coupled....
, i.e. contain few nonzero entries. Therefore, specifically taylored matrix algorithms can be used in network theory
Network theory

Network theory is an area of applied mathematics and part of graph theory. It has application in many disciplines including particle physics, computer science, biology, economics, operations research, and sociology....
.

Analysis and geometry

Saddle Point
The Hessian matrix
Hessian matrix

In mathematics, the Hessian matrix is the square matrix of second-order partial derivatives of a function ; that is, it describes the local curvature of a function of many variables....
 of a differentiable function f: Rn ? R consists of the second derivatives of f with respect to the several coordinate directions, i.e. . It encodes information about the local growth behaviour of the function: given a critical point
Critical point (mathematics)

In mathematics, a critical point is a Point on the domain of a function of a function where:* one dimension: the derivative is equality to 0 or a point where the function ceases to be differentiable....
 x = (x1, ..., xn), i.e., a point where the first partial derivatives of f vanish, the function has a local minimum if the Hessian matrix is positive definite. Quadratic programming
Quadratic programming

Quadratic programming is a special type of mathematical optimization problem. It is the problem of optimizing a quadratic function of several variables subject to linear constraints on these variables...
 can be used to find global minima or maxima of quadratic functions closely related to the ones attached to matrices (see above).

Another matrix frequently used in geometrical situations is the Jacobi matrix
Jacobi matrix

Jacobi matrix may refer to:* Jacobian matrix * A three-diagonal symmetric matrix ...
 of a differentiable map f: Rn ? Rm. If f1, ..., fm denote the components of f, then the Jacobi matrix is defined as . If n > m, and if the rank of the Jacobi matrix attains its maximal value m, f is locally invertible at that point, by the implicit function theorem
Implicit function theorem

In the branch of mathematics called multivariable calculus, the implicit function theorem is a tool which allows relation #Formal definitions to be converted to function s....
.

Partial differential equation
Partial differential equation

In mathematics, partial differential equations are a type of differential equation, i.e., a Relation involving an unknown Function of several independent variables and its partial derivatives with respect to those variables....
s can be classified by considering the matrix of coefficients of the highest-order differential operators of the equation. For elliptic partial differential equations this matrix is positive definite, which has decisive influence on the set of possible solutions of the equation in question.

The finite element method
Finite element method

The finite element method is a numerical analysis for finding approximate solutions of partial differential equations as well as of integral equations....
 is an important numerical method to solve partial differential equations, widely applied in simulating complex physical systems. It attempts to approximate the solution to some equation by piecewise linear functions, where the pieces are chosen with respect to a sufficiently fine grid, which in turn can be recast as a matrix equation.

Probability theory and statistics

Stochastic matrices
Stochastic matrix

In mathematics, a stochastic matrix, probability matrix, or transition matrix is used to describe the transitions of a Markov chain....
 are square matrices whose rows are probability vector
Probability vector

In mathematics and statistics, a probability vector or stochastic vector is a vector space with non-negative entries that add up to one....
s, i.e., whose entries sum up to one. Stochastic matrices are used to define Markov chain
Markov chain

In mathematics, a Markov chain, named after Andrey Markov, is a stochastic process with the Markov property. Having the Markov property means that, given the present state, future states are independent of the past states. In other words, the description of the present state fully captures all the information that could influence th...
s with finitely many states. In the image at the right, particles can attain two states ("1" or "2"). Each row of the stochastic matrix gives the probability distribution for the next position of some particle which is currently in the state to which the row corresponds. In the example at the right, particles move randomly between the two states, initially they are all in state "1" (red chain, starting from below) and state "2" (black, respectively), the transition matrices are given by and , respectively, e.g. the probability for a particle in state "2" to stay in state "2" is 1 in the first example. Therefore this state is absorbing, i.e., all particles attain this state eventually. This property, and the limiting value in the other case can be read of from the eigenvectors of the transition matrices.

The covariance matrix
Covariance matrix

In statistics and probability theory, the covariance matrix is a matrix of covariances between elements of a vector. It is the natural generalization to higher dimensions of the concept of the variance of a scalar -valued random variable....
 encodes the mutual variance
Variance

In probability theory and statistics, the variance of a random variable, probability distribution, or sample is one measure of statistical dispersion, averaging the squared distance of its possible values from the expected value ....
 of several random variable
Random variable

In mathematics, random variables are used in the study of Randomness and probability. They were developed to assist in the analysis of Game of chance, stochastic events, and the results of experiment by capturing only the mathematical properties necessary to answer probability questions....
s.

Symmetries and transformations in physics

Linear transformations and the associated symmetries
Symmetry

Symmetry generally conveys two primary meanings. The first is an imprecise sense of harmonious or aesthetically-pleasing proportionality and balance; such that it reflects beauty or perfection....
 play a key role in modern physics. For example, elementary particle
Elementary particle

In particle physics, an elementary particle or fundamental particle is a wiktionary:particle not known to have substructure; that is, it is not known to be made up of smaller particles....
s in quantum field theory
Quantum field theory

Quantum field theory or QFT provides a theoretical framework for constructing quantum mechanics models of systems classically described by field or of Many-body problem....
 are classified as representations of the Lorentz group
Lorentz group

In physics , the Lorentz group is the group of all Lorentz transformations of Minkowski spacetime, the classical field theory setting for all physics....
 of special relativity and, more specifically, by their behavior under the spin group
Spin group

In mathematics the spin group Spin is the covering space of the special orthogonal group SO, such that there exists a short exact sequence of Lie groups...
. Concrete representations involving the Pauli matrices
Pauli matrices

The Pauli matrices are a set of 2 × 2 complex number Hermitian matrix and Unitary matrix matrix Usually indicated by the Greek letter 'sigma' , they are occasionally denoted with a 'tau' when used in connection with isospin symmetries....
 and more general gamma matrices
Gamma matrices

In mathematical physics, the gamma matrices, , also known as the Dirac matrices, form a matrix-valued representation of a set of orthogonal basis vectors for contravariant vectors in space time, from which can be constructed a Clifford algebra....
 are an integral part of the physical description of fermion
Fermion

In particle physics, fermions are subatomic particle which obey Fermi-Dirac statistics; they are named after Enrico Fermi. In contrast to bosons, which have Bose-Einstein statistics, only one fermion can occupy a quantum state at a given time; this is the Pauli Exclusion Principle....
s, which behave as spinor
Spinor

In mathematics and physics, in particular in the theory of the orthogonal groups , spinors are elements of a complex vector space introduced to expand the notion of spatial vector and tensor....
s. For the three lightest quark
Quark

Quarks are a type of elementary particle and major constituents of matter. They are the only particles in the Standard Model to experience all four fundamental interaction, which are also known as fundamental interactions....
s, there is a group-theoretical representation involving the special unitary group
Special unitary group

In mathematics, the special unitary group of degree n, denoted SU, is the group of n×n unitary matrix Matrix with determinant 1....
 SU(3); for their calculations, physicists use a convenient matrix representation known as the Gell-Mann matrices
Gell-Mann matrices

The Gell-Mann matrices, named for Murray Gell-Mann, are one possible representation of the Lie group#The Lie algebra associated to a Lie groups of the special unitary group called SU....
, which are also used for the SU(3) gauge group that forms the basis of the mordern description of strong nuclear interactions, quantum chromodynamics
Quantum chromodynamics

Quantum chromodynamics is a theory of the strong interaction , a fundamental force describing the interactions of the quarks and gluons making up hadrons ....
. The Cabibbo-Kobayashi-Maskawa matrix
Cabibbo-Kobayashi-Maskawa matrix

In the Standard Model of particle physics, the Cabibbo?Kobayashi?Maskawa matrix is a unitary matrix which contains information on the strength of flavour-changing weak decays....
, in turn, expresses the fact that the basic quark states that are important for weak interaction
Weak interaction

The weak interaction is one of the four fundamental interactions of nature. In the Standard Model of particle physics, it is due to the exchange of the heavy W and Z bosons....
s are not the same as, but linearly related to the basic quark states that define particles with specific and distinct mass
Mass

In physical science, mass refers to the degree of acceleration a body acquires when subject to a force: bodies with greater mass are accelerated less by the same force....
es.

Linear combinations of quantum states


The first model of quantum mechanics
Quantum mechanics

Quantum mechanics is a set of principles underlying the most fundamental known description of all physical systems at the microscopic scale . Notable amongst these principles are both a dual wave-like and particle-like behavior of matter and radiation, and prediction of probabilities in situations where classical physics predicts certaintie...
 (Heisenberg
Werner Heisenberg

Werner Heisenberg was a German Theoretical physics who made foundational contributions to quantum mechanics and is best known for asserting the uncertainty principle of quantum theory....
, 1925) represented the theory's operators by infinite-dimensional matrices acting on quantum states. This is also referred to as matrix mechanics
Matrix mechanics

Matrix mechanics is a formulation of quantum mechanics created by Werner Heisenberg, Max Born, and Pascual Jordan in 1925.Matrix mechanics was the first complete and correct definition of quantum mechanics....
. One particular example is the density matrix
Density matrix

In quantum mechanics, a density matrix is a self-adjoint positive-semidefinite matrix, , of trace class one, that describes the statistical state of a quantum system....
 that characterizes the "mixed" state of a quantum system as a linear combination of elementary, "pure" eigenstates.

Another matrix serves as a key tool for describing the scattering experiments which form the cornerstone of experimental particle physics: Collision reactions such as occur in particle accelerator
Particle accelerator

A particle accelerator is a device that uses electric fields to propel electric charge Elementary particles to high speeds and to contain them....
s, where non-interacting particles head towards each other and collide in a small interaction zone, with a new set of non-interacting particles as the result, can be described as the scalar product of outgoing particle states and a linear combination of ingoing particle states. The linear combination is given by a matrix known as the S-matrix, which encodes all information about the possible interactions between particles.

Normal Modes


A general application of matrices in physics is to the description of linearly coupled harmonic systems. The equations of motion
Equation of motion

In physics, equations of motion are equations that describe the behavior of a system as a function of time. Sometimes the term refers to the differential equations that the system satisfies , and sometimes to the solutions to those equations....
 of such systems can be described in matrix form, with a mass matrix multiplying a generalized velocity to give the kinetic term, and a force matrix multiplying a displacement vector to characterize the interactions. The best way to obtain solutions is to determine the system's eigenvectors, its normal mode
Normal mode

A normal mode of an oscillation is a pattern of motion in which all parts of the system move sinusoidally with the same frequency. The frequencies of the normal modes of a system are known as its natural frequencies or resonant frequencies....
s, by diagonalizing the matrix equation. Techniques like this are crucial when it comes to describing the internal dynamics of molecules: the internal vibrations of systems consisting of mutually bound component atoms. They are also needed for describing mechanical vibrations, and oscillations in electrical circuits.

Geometrical optics


Geometrical optics
Geometrical optics

As a mathematical study, geometrical optics emerges as a short-wavelength limit for solutions to hyperbolic partial differential equations. For a less mathematical introduction, please see optics....
 provides further matrix applications. In this approximative theory, the wave nature of light is neglected. The result is a model in which light rays are indeed geometrical rays. If the deflection of light rays by optical elements is small, the action of a lens
Lens (optics)

A lens is an optics device with perfect or approximate axial symmetry which transmittance and refraction light, converging or diverging the beam....
 or reflective element on a given light ray can be expressed as multiplication of a two-component vector with a two-by-two matrix called ray transfer matrix: the vector's components are the light ray's slope and its distance from the optical axis, while the matrix encodes the properties of the optical element. The matrix characterizing an optical system consisting of a combination of lenses and/or reflective elements is simply the product of the components' matrices.

Computational neuroscience


Some computational models of how the brain could store information (and to which some liken certain hippocampal circuits
Hippocampus

The hippocampus is a brain structure located inside the medial temporal lobe of the cerebral cortex, and therefore is part of the telencephalon ....
) are based on correlation matrices. For an example, see McNaughton 1989.

See also

  • linear least squares
    Linear least squares

    Linear least squares is an important computational problem, that arises primarily in applications when it is desired to fit a linear function mathematical model to measurements obtained from experiments....
  • Gram-Schmidt process
  • Matrix calculus
    Matrix calculus

    In mathematics, matrix calculus is a specialized notation for doing multivariable calculus, especially over spaces of matrix , where it defines the matrix derivative....
  • Kalman filter
    Kalman filter

    The Kalman filter is an efficient recursive filter that estimates the state of a Linear system from a series of noise measurements. It is used in a wide range of engineering applications from radar to computer vision, and is an important topic in control theory and control systems engineering....
  • Random matrix
    Random matrix

    In probability theory and statistics, a random matrix is a matrix -valued random variable. Many important properties of physical systems can be represented mathematically as matrix problems....
     in statistics, Matrix normal distribution
    Matrix normal distribution

    The matrix normal distribution is a probability distribution that is a generalization of the normal distribution to matrix-valued random variables....
  • Stoichiometry
    Stoichiometry

    Stoichiometry is the calculation of quantitative relationships of the reactants and Product in a balanced chemical reaction .Etymology...
     matrix in chemistry
  • List of matrices
    List of matrices

    This page lists some important classes of matrix used in mathematics, science and engineering:...
  • Jacobian conjecture
    Jacobian conjecture

    In mathematics, the Jacobian conjecture is a celebrated problem on polynomials in several variables. It was first posed in 1939 by Ott-Heinrich Keller....


Footnotes


Physics references


External links

History


Online books

Online Matrix Calculators

, a freeware package for matrix algebra and statistics