Jacobi's formula

From Wikipedia, the free encyclopedia

In matrix calculus, Jacobi's formula expresses the differential of the determinant of a matrix A in terms of the adjugate of A and the differential of A. The formula is

d \, \mbox{det} (A) = \mbox{tr} (\mbox{adj}(A) \, dA).

It is named after the mathematician C.G.J. Jacobi.

[edit] Derivation

We first prove a preliminary lemma:

Lemma. Given a pair of square matrices A and B of the same dimension n, then

\sum_i \sum_j A_{ij} B_{ij} = \mbox{tr} (A^\top B).

Proof. The product AB of the pair of matrices has components

(AB)_{jk} = \sum_i A_{ji} B_{ik}.\,

Replacing the matrix A by its transpose AT is equivalent to permuting the indices of its components:

(A^\top B)_{jk} = \sum_i A_{ij} B_{ik}.

The result follows by taking the trace of both sides:

\mbox{tr} (A^\top B) = \sum_j (A^\top B)_{jj} = \sum_j \sum_i A_{ij} B_{ij} = \sum_i \sum_j A_{ij} B_{ij}.\ \square


Theorem. d \, \mbox{det} (A) = \mbox{tr} (\mbox{adj}(A) \, dA).

Proof. Laplace's formula for the determinant of a matrix A can be stated as

\mbox{det}(A) = \sum_j A_{ij} \mbox{adj}^\top (A)_{ij}.

Notice that the summation is performed over some arbitrary row i of the matrix.

The determinant of A can be considered to be a function of the elements of A:

det(A) = F(A11,A12,...,A21,A22,...,Ann)

so that its differential is

d\, \mbox{det}(A) = \sum_i \sum_j {\partial F \over \partial A_{ij}} \,dA_{ij}.

This summation is performed over all n×n elements of the matrix.

To find ∂F / ∂Aij consider that in the right side of Laplace's formula, index i can be chosen at will (in order to optimize calculations: any other choice would eventually yield the same result, but it could be much harder). In particular, it can be chosen to match the first index of ∂ / ∂Aij:

{\partial \, \mbox{det}(A) \over \partial A_{ij}} = {\partial \sum_k A_{ik} \mbox{adj}^\top(A)_{ik} \over \partial A_{ij}} = \sum_k {\partial A_{ik} \mbox{adj}^\top(A)_{ik} \over \partial A_{ij}}.

Now, if an element of a matrix Aij and a cofactor adjT(A)ik of element Aik lie on the same row (or column), then the cofactor will not be a function of Aij, because the cofactor of Aik is expressed in terms of elements not in its own row (nor column). Thus,

{\partial \, \mbox{adj}^\top(A)_{ik} \over \partial A_{ij}} = 0,

so

{\partial \, \mbox{det}(A) \over \partial A_{ij}} = \sum_k \mbox{adj}^\top(A)_{ik} {\partial  A_{ik} \over \partial A_{ij}}.

All the elements of A are independent of each other, i.e.

{\partial A_{ik} \over \partial A_{ij}} = \delta_{jk},

where δ is the Kronecker delta, so

{\partial \, \mbox{det}(A) \over \partial A_{ij}} = \sum_k  \mbox{adj}^\top(A)_{ik} \delta_{jk} = \mbox{adj}^\top(A)_{ij}.

Therefore,

d(\mbox{det}(A)) = \sum_i \sum_j \mbox{adj}^\top(A)_{ij} \,d A_{ij},

and applying the Lemma yields

d(\mbox{det}(A)) = \mbox{tr}(\mbox{adj}(A) \,dA).\ \square