Gramian matrix

From Wikipedia, the free encyclopedia

In linear algebra, the Gramian matrix (or Gram matrix or Gramian) of a set of vectors $v_1,\dots, v_n$ in an inner product space is the symmetric matrix of inner products, whose entries are given by $G i j = (v i | v j)$ .

An important application is to compute linear independence: a set of vectors is linearly independent if and only if the Gram determinant (the determinant of the Gram matrix) is non-zero.

It is named for Jørgen Pedersen Gram.

1 Examples
- 1.1 Applications
2 Properties
- 2.1 Positive semidefinite
- 2.2 Change of basis
3 Gram determinant
4 External links

[edit] Examples

Most commonly, the vectors are elements of a Euclidean space, or are functions in an $L 2$ space, such as continuous functions on a compact interval $[a, b]$ (which are a subspace of $L 2 ([a, b])$ ).

Given real-valued functions $\{l_i(\cdot),\,i=1,\dots,n\}$ on the interval $[t 0, t f]$ , the Gram matrix $G = [G i j]$ , is given by the standard inner product on functions: $G_{ij}=\int_{t_0}^{t_f} l_i(\tau)l_j(\tau)\, d\tau$ .

Given a matrix $A$ , the matrix $A T A$ is a Gram matrix (of the columns of $A$ ), while the matrix $A A T$ is the Gram matrix of the rows of $A$ .

For a general bilinear form B on a finite-dimensional vector space over any field we can define a Gram matrix G attached to a set of vectors $v_1,\dots, v_n$ by $G_{i,j} = B(v_i,v_j) \,$ . The matrix will be symmetric if the bilinear form B is.

[edit] Applications

If the vectors are centered random variables, the Gramian is the covariance matrix.
In quantum chemistry, the Gram matrix of a set of basis vectors is the overlap matrix.
In control theory (or more generally systems theory), the controllability Gramian and observability Gramian determine properties of a linear system.
Gramian matrices arise in covariance structure model fitting (see e.g., Jamshidian and Bentler, 1993, Applied Psychological Measurement, Volume 18, pp. 79-94).
In the Finite Element Method, the Gram matrix arises from approximating a function from a finite dimensional space; the Gram matrix entries are then the inner products of the basis functions of the finite dimensional subspace.

[edit] Properties

[edit] Positive semidefinite

The Gramian matrix is positive semidefinite, and every positive semidefinite matrix is the Gramian matrix for some set of vectors. This set of vectors is not in general unique: the Gramian matrix of any orthonormal basis is the identity matrix.

The infinite-dimensional analog of this statement is Mercer's theorem.

[edit] Change of basis

Under change of basis represented by an invertible matrix P, the Gram matrix will change by a matrix congruence to $P T G P$ .

[edit] Gram determinant

The Gram determinant or Gramian is the determinant of the Gram matrix:

$G(x_1,\dots, x_n)=\begin{vmatrix} (x_1|x_1) & (x_1|x_2) &\dots & (x_1|x_n)\\ (x_2|x_1) & (x_2|x_2) &\dots & (x_2|x_n)\\ \vdots&\vdots&&\vdots\\ (x_n|x_1) & (x_n|x_2) &\dots & (x_n|x_n)\end{vmatrix}.$

Geometrically, the Gram determinant is the square of the volume of the parallelepiped formed by the vectors. In particular, the vectors are linearly independent if and only if the Gram determinant is nonzero (if and only if the Gram matrix is nonsingular).