Spectral theorem
≈ 14 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
In linear algebra and functional analysis, a spectral theorem is a result about when a linear operator or matrix can be diagonalized (that is, represented as a diagonal matrix in some basis). This is extremely useful because computations involving a diagonalizable matrix can often be reduced to much simpler computations involving the corresponding diagonal matrix of eigenvalues. The concept of diagonalization is relatively straightforward for operators on finite-dimensional vector spaces but requires some modification for operators on infinite-dimensional spaces. In general, the spectral theorem identifies a class of linear operators that can be modeled by multiplication operators, which are as simple as one can hope to find. In more abstract language, the spectral theorem is a statement about commutative C*-algebras. See also spectral theory for a historical perspective. Examples of operators to which the spectral theorem applies are self-adjoint operators or more generally normal operators on Hilbert spaces. The spectral theorem also provides a canonical decomposition, called the spectral decomposition, of the underlying vector space on which the operator acts. Augustin-Louis Cauchy proved the spectral theorem for symmetric matrices, i.e., that every real, symmetric matrix is diagonalizable. In addition, Cauchy was the first to be systematic about determinants.…
In linear algebra and functional analysis, a spectral theorem is a result about when a linear operator or matrix can be diagonalized (that is, represented as a diagonal matrix in some basis). This is extremely useful because computations involving a diagonalizable matrix can often be reduced to much simpler computations involving the corresponding diagonal matrix of eigenvalues. The concept of diagonalization is relatively straightforward for operators on finite-dimensional vector spaces but requires some modification for operators on infinite-dimensional spaces. In general, the spectral theorem identifies a class of linear operators that can be modeled by multiplication operators, which are as simple as one can hope to find. In more abstract language, the spectral theorem is a statement about commutative C*-algebras. See also spectral theory for a historical perspective. Examples of operators to which the spectral theorem applies are self-adjoint operators or more generally normal operators on Hilbert spaces. The spectral theorem also provides a canonical decomposition, called the spectral decomposition, of the underlying vector space on which the operator acts. Augustin-Louis Cauchy proved the spectral theorem for symmetric matrices, i.e., that every real, symmetric matrix is diagonalizable. In addition, Cauchy was the first to be systematic about determinants. The spectral theorem as generalized by John von Neumann is today perhaps the most important result of operator theory. This article mainly focuses on the simplest kind of spectral theorem, that for a self-adjoint operator on a Hilbert space. However, as noted above, the spectral theorem also holds for normal operators on a Hilbert space. \langle A x, y \rangle = \langle x, A y \rangle. An equivalent condition is that , where is the Hermitian conjugate of . In the case that is identified with a Hermitian matrix, the matrix of is equal to its conjugate transpose. (If is a real matrix, then this is equivalent to , that is, is a symmetric matrix.) This condition implies that all eigenvalues of a Hermitian map are real: To see this, it is enough to apply it to the case when is an eigenvector. (Recall that an eigenvector of a linear map is a non-zero vector such that for some scalar . The value is the corresponding eigenvalue. Moreover, the eigenvalues are roots of the characteristic polynomial.) We provide a sketch of a proof for the case where the underlying field of scalars is the complex numbers. By the fundamental theorem of algebra, applied to the characteristic polynomial of , there is at least one complex eigenvalue and corresponding eigenvector , which must by definition be non-zero. Then since \lambda_1 \langle v_1, v_1 \rangle = \langle A (v_1), v_1 \rangle = \langle v_1, A(v_1) \rangle = \bar\lambda_1 \langle v_1, v_1 \rangle, we find that is real. Now consider the space \mathcal{K}^{n-1} = \text{span}(v_1)^\perp , the orthogonal complement of . By Hermiticity, \mathcal{K}^{n-1} is an invariant subspace of . To see that, consider any k \in \mathcal{K}^{n-1} so that \langle k, v_1 \rangle = 0 by definition of \mathcal{K}^{n-1} . To satisfy invariance, we need to check if A(k) \in \mathcal{K}^{n-1} . This is true because, \langle A(k), v_1 \rangle = \langle k, A(v_1) \rangle = \langle k, \lambda_1 v_1 \rangle = 0 . Applying the same argument to \mathcal{K}^{n-1} shows that has at least one real eigenvalue \lambda_2 and corresponding eigenvector v_2 \in \mathcal{K}^{n-1} \perp v_1 . This can be used to build another invariant subspace \mathcal{K}^{n-2} = \text{span}(\{v_1, v_2\})^\perp . Finite induction then finishes the proof. The matrix representation of in a basis of eigenvectors is diagonal, and by the construction the proof gives a basis of mutually orthogonal eigenvectors; by choosing them to be unit vectors one obtains an orthonormal basis of eigenvectors. can be written as a linear combination of pairwise orthogonal projections, called its spectral decomposition. Let V_{\lambda} = \{v \in V: A v = \lambda v\} be the eigenspace corresponding to an eigenvalue \lambda . Note that the definition does not depend on any choice of specific eigenvectors. In general, is the orthogonal direct sum of the spaces V_{\lambda} where the \lambda ranges over the spectrum of A . When the matrix being decomposed is Hermitian, the spectral decomposition is a special case of the Schur decomposition (see the proof in case of normal matrices below). A = U\Sigma V^{*} , where U \in \mathbb{C}^{m \times m} and V \in \mathbb{C}^{n \times n} are unitary matrices and \Sigma \in \mathbb{R}^{m \times n} is a diagonal matrix with nonnegative entries. The diagonal entries of \Sigma are uniquely determined by A and are known as the singular values of A . If A is Hermitian, then A^* = A and V \Sigma U^* = U \Sigma V^* which implies U = V . A = U D U^*, where is a diagonal matrix. Then, the entries of the diagonal of are the eigenvalues of . The column vectors of are the eigenvectors of and they are orthonormal. Unlike the Hermitian case, the entries of need not be real.
Possible absence of eigenvectors
The next generalization we consider is that of bounded self-adjoint operators on a Hilbert space. Such operators may have no eigenvectors: for instance let be the operator of multiplication by on L^2([0,1]) , that is, [A f](t) = t f(t). This operator does not have any eigenvectors in L^2([0,1]) . However, its spectrum, suitably defined, is still equal to [0,1] , see spectrum of bounded operator. It does also have eigenvectors in a larger space. Namely the distribution f(t)=\delta(t-t_0) , where \delta is the Dirac delta function, is an eigenvector when construed in an appropriate sense. The Dirac delta function is however not a function in the classical sense and does not lie in the Hilbert space . Thus, the delta-functions are "generalized eigenvectors" of A but not eigenvectors in the usual sense.
Spectral subspaces and projection-valued measures
In the absence of (true) eigenvectors, one can look for a "spectral subspace" consisting of an almost eigenvector, i.e., a closed subspace V_E of V associated with a Borel set E \subset \sigma(A) in the spectrum of A . This subspace can be thought of as the closed span of generalized eigenvectors for A with eigenvalues in E . In the above example, where [A f](t) = t f(t), \; we might consider the subspace of functions supported on a small interval [a,a+\varepsilon] inside [0,1] . This space is invariant under A and for any f in this subspace, Af is very close to af . Each subspace, in turn, is encoded by the associated projection operator, and the collection of all the subspaces is then represented by a projection-valued measure. One formulation of the spectral theorem expresses the operator as an integral of the coordinate function over the operator's spectrum \sigma(A) with respect to a projection-valued measure. A = \int_{\sigma(A)} \lambda \, d \pi (\lambda). When the self-adjoint operator in question is compact, this version of the spectral theorem reduces to something similar to the finite-dimensional spectral theorem above, except that the operator is expressed as a finite or countably infinite linear combination of projections, that is, the measure consists only of atoms.
Multiplication operator version
An alternative formulation of the spectral theorem says that every bounded self-adjoint operator is unitarily equivalent to a multiplication operator, a relatively simple type of operator. Multiplication operators are a direct generalization of diagonal matrices. A finite-dimensional Hermitian vector space V may be coordinatized as the space of functions f: B \to \C from a basis B to the complex numbers, so that the B -coordinates of a vector are the values of the corresponding function f . The finite-dimensional spectral theorem for a self-adjoint operator A: V \to V states that there exists an orthonormal basis of eigenvectors B , so that the inner product becomes the dot product with respect to the B -coordinates: thus V is isomorphic to L^2( B ,\mu ) for the discrete unit measure \mu on B . Also A is unitarily equivalent to the multiplication operator [Tf](v) = \lambda(v) f(v) , where \lambda(v) is the eigenvalue of v \in B : that is, A multiplies each B -coordinate by the corresponding eigenvalue \lambda(v) , the action of a diagonal matrix. Finally, the operator norm |A| = |T| is equal to the magnitude of the largest eigenvalue |\lambda|_\infty . The spectral theorem is the beginning of the vast research area of functional analysis called operator theory; see also spectral measure. There is also an analogous spectral theorem for bounded normal operators on Hilbert spaces. The only difference in the conclusion is that now \lambda may be complex-valued.
Direct integrals
There is also a formulation of the spectral theorem in terms of direct integrals. It is similar to the multiplication-operator formulation, but more canonical. Let A be a bounded self-adjoint operator and let \sigma (A) be the spectrum of A . The direct-integral formulation of the spectral theorem associates two quantities to A . First, a measure \mu on \sigma (A) , and second, a family of Hilbert spaces \{H_{\lambda}\},\,\,\lambda\in\sigma (A). We then form the direct integral Hilbert space \int_\mathbf{R}^\oplus H_{\lambda}\, d \mu(\lambda). The elements of this space are functions (or "sections") s(\lambda),\,\,\lambda\in\sigma(A), such that s(\lambda)\in H_{\lambda} for all \lambda . The direct-integral version of the spectral theorem may be expressed as follows: {{math theorem|math_statement= If A is a bounded self-adjoint operator, then A is unitarily equivalent to the "multiplication by \lambda " operator on \int_\mathbf{R}^\oplus H_{\lambda}\, d \mu(\lambda) for some measure \mu and some family \{H_{\lambda}\} of Hilbert spaces. The measure \mu is uniquely determined by A up to measure-theoretic equivalence; that is, any two measure associated to the same A have the same sets of measure zero. The dimensions of the Hilbert spaces H_{\lambda} are uniquely determined by A up to a set of \mu -measure zero.}} The spaces H_{\lambda} can be thought of as something like "eigenspaces" for A . Note, however, that unless the one-element set \lambda has positive measure, the space H_{\lambda} is not actually a subspace of the direct integral. Thus, the H_{\lambda} 's should be thought of as "generalized eigenspace"—that is, the elements of H_{\lambda} are "eigenvectors" that do not actually belong to the Hilbert space. Although both the multiplication-operator and direct integral formulations of the spectral theorem express a self-adjoint operator as unitarily equivalent to a multiplication operator, the direct integral approach is more canonical. First, the set over which the direct integral takes place (the spectrum of the operator) is canonical. Second, the function we are multiplying by is canonical in the direct-integral approach: Simply the function \lambda\mapsto\lambda .
Cyclic vectors and simple spectrum
A vector \varphi is called a cyclic vector for A if the vectors \varphi,A\varphi,A^2\varphi,\ldots span a dense subspace of the Hilbert space. Suppose A is a bounded self-adjoint operator for which a cyclic vector exists. In that case, there is no distinction between the direct-integral and multiplication-operator formulations of the spectral theorem. Indeed, in that case, there is a measure \mu on the spectrum \sigma(A) of A such that A is unitarily equivalent to the "multiplication by \lambda " operator on L^2(\sigma(A),\mu) . This result represents A simultaneously as a multiplication operator and as a direct integral, since L^2(\sigma(A),\mu) is just a direct integral in which each Hilbert space H_{\lambda} is just \mathbb{C} . Not every bounded self-adjoint operator admits a cyclic vector; indeed, by the uniqueness in the direct integral decomposition, this can occur only when all the H_{\lambda} 's have dimension one. When this happens, we say that A has "simple spectrum" in the sense of spectral multiplicity theory. That is, a bounded self-adjoint operator that admits a cyclic vector should be thought of as the infinite-dimensional generalization of a self-adjoint matrix with distinct eigenvalues (i.e., each eigenvalue has multiplicity one). Although not every A admits a cyclic vector, it is easy to see that we can decompose the Hilbert space as a direct sum of invariant subspaces on which A has a cyclic vector. This observation is the key to the proofs of the multiplication-operator and direct-integral forms of the spectral theorem.
Functional calculus
One important application of the spectral theorem (in whatever form) is the idea of defining a functional calculus. That is, given a function f defined on the spectrum of A , we wish to define an operator f(A) . If f is simply a positive power, f(x) = x^n , then f(A) is just the n -th power of A , A^n . The interesting cases are where f is a nonpolynomial function such as a square root or an exponential. Either of the versions of the spectral theorem provides such a functional calculus. In the direct-integral version, for example, f(A) acts as the "multiplication by f " operator in the direct integral: [f(A)s](\lambda) = f(\lambda) s(\lambda). That is to say, each space H_{\lambda} in the direct integral is a (generalized) eigenspace for f(A) with eigenvalue f(\lambda) .
References
Sheldon Axler, Linear Algebra Done Right, Springer Verlag, 1997 Paul Halmos, "What Does the Spectral Theorem Say?", American Mathematical Monthly, volume 70, number 3 (1963), pages 241–247 Other link M. Reed and B. Simon, Methods of Mathematical Physics, vols I–IV, Academic Press 1972. G. Teschl, Mathematical Methods in Quantum Mechanics with Applications to Schrödinger Operators, https://www.mat.univie.ac.at/~gerald/ftp/book-schroe/, American Mathematical Society, 2009.
Text derived from https://en.wikipedia.org/w/index.php?oldid=1364030893 under CC BY-SA 4.0; modifications have been made.