In mathematics, particularly linear algebra and functional analysis, a spectral theorem is a result about when a linear operator or matrix can be diagonalized (that is, represented as a diagonal matrix in some basis). This is extremely useful because computations involving a diagonalizable matrix can often be reduced to much simpler computations involving the corresponding diagonal matrix. The concept of diagonalization is relatively straightforward for operators on finite-dimensional vector spaces but requires some modification for operators on infinite-dimensional spaces. In general, the spectral theorem identifies a class of linear operators that can be modeled by multiplication operators, which are as simple as one can hope to find. In more abstract language, the spectral theorem is a statement about commutative C*-algebras. See also spectral theory for a historical perspective.

Examples of operators to which the spectral theorem applies are self-adjoint operators or more generally normal operators on Hilbert spaces.

Spectral theorem

The spectral theorem also provides a canonical decomposition, called the spectral decomposition, of the underlying vector space on which the operator acts.

Spectral theorem

Augustin-Louis Cauchy proved the spectral theorem for symmetric matrices, i.e., that every real, symmetric matrix is diagonalizable. In addition, Cauchy was the first to be systematic about determinants. The spectral theorem as generalized by John von Neumann is today perhaps the most important result of operator theory.

Spectral theorem

This article mainly focuses on the simplest kind of spectral theorem, that for a self-adjoint operator on a Hilbert space. However, as noted above, the spectral theorem also holds for normal operators on a Hilbert space.

Finite-dimensional case

Hermitian maps and Hermitian matrices

We begin by considering a Hermitian matrix on (but the following discussion will be adaptable to the more restrictive case of symmetric matrices on We consider a Hermitian map on a finite-dimensional complex inner product space endowed with a positive definite sesquilinear inner product . The Hermitian condition on means that for all ,

An equivalent condition is that , where is the Hermitian conjugate of . In the case that is identified with a Hermitian matrix, the matrix of is equal to its conjugate transpose. (If is a real matrix, then this is equivalent to , that is, is a symmetric matrix.)

This condition implies that all eigenvalues of a Hermitian map are real: To see this, it is enough to apply it to the case when is an eigenvector. (Recall that an eigenvector of a linear map is a non-zero vector such that for some scalar . The value is the corresponding eigenvalue. Moreover, the eigenvalues are roots of the characteristic polynomial.)

We provide a sketch of a proof for the case where the underlying field of scalars is the complex numbers.

By the fundamental theorem of algebra, applied to the characteristic polynomial of , there is at least one eigenvalue and eigenvector , which must by definition be non-zero. Then since

we find that is real. Now consider the space , the orthogonal complement of . By Hermiticity, is an invariant subspace of . Applying the same argument to shows that has an eigenvector . Finite induction then finishes the proof.

The spectral theorem holds also for symmetric maps on finite-dimensional real inner product spaces, but the existence of an eigenvector does not follow immediately from the fundamental theorem of algebra. To prove this, consider as a Hermitian matrix and use the fact that all eigenvalues of a Hermitian matrix are real.

The matrix representation of in a basis of eigenvectors is diagonal, and by the construction the proof gives a basis of mutually orthogonal eigenvectors; by choosing them to be unit vectors one obtains an orthonormal basis of eigenvectors. can be written as a linear combination of pairwise orthogonal projections, called its spectral decomposition. Let

be the eigenspace corresponding to an eigenvalue . Note that the definition does not depend on any choice of specific eigenvectors. is the orthogonal direct sum of the spaces where the index ranges over eigenvalues.

In other words, if denotes the orthogonal projection onto , and are the eigenvalues of , then the spectral decomposition may be written as

If the spectral decomposition of A is , then and for any scalar It follows that for any polynomial one has

The spectral decomposition is a special case of both the Schur decomposition and the singular value decomposition.