Reproducing kernel Hilbert space

From Wikipedia, the free encyclopedia

In functional analysis (a branch of mathematics), a reproducing kernel Hilbert space is a function space in which pointwise evaluation is a continuous linear functional. Equivalently, they are spaces that can be defined by reproducing kernels. The subject was originally and simultaneously developed by Nachman Aronszajn (1907-1980) and Stephan Bergman (1895-1987) in 1950.

In this article we assume that Hilbert spaces are complex. This is because many of the examples of reproducing kernel Hilbert spaces are spaces of analytic functions. Also recall the sesquilinearity convention: the inner product is linear in the second variable.

Let X be an arbitrary set and H a Hilbert space of complex-valued functions on X. H is a reproducing kernel Hilbert space iff the linear map

f \mapsto f(x)

from H to the complex numbers is continuous for any x in X. By the Riesz representation theorem, this implies that for given x there exists an element Kx of H with the property that:

f(x) = \langle K_x, f \rangle \quad \forall f \in H \quad (*)

The function

K(x,y) \ \stackrel{\mathrm{def}}{=}\   K_x(y)

is called a reproducing kernel for the Hilbert space. In fact, K is uniquely determined by the above condition (*).

For example, when X is finite and H consists of all complex-valued functions on X, then an element of H can be represented as an array of complex numbers. If the usual inner product is used, then Kx is the function whose value is 1 at x and 0 everywhere else.

In other contexts, (*) amounts to saying

f(x)=\int_X K(x,y) f(y)\,dy

for every f, where X is often the real numbers or Rn.

Contents

[edit] Bergman kernel

The Bergman kernel is defined for open sets D in Cn. Take the Hilbert H space of square-integrable functions, for the Lebesgue measure on D, that are holomorphic functions. The theory is non-trivial in such cases as there are such functions, which are not identically zero. Then H is a reproducing kernel space, with kernel function the Bergman kernel; this example, with n = 1, was introduced by Bergman in 1922.

[edit] Moore-Aronszajn theorem

Given a positive definite kernel K, we can construct a unique RKHS H with K as the reproducing kernel. A positive definite kernel is a function on X \otimes X with the following property. For all natural number n, for all x_1, \ldots, x_n in X, and for all \alpha_1, \ldots, \alpha_n in a real or complex,

\sum_{i=1}^n \sum_{j=1}^n \alpha_i \alpha_j K(x_i, x_j) \ge 0.

[edit] See also

[edit] References

  • Nachman Aronszajn, Theory of Reproducing Kernels, Transactions of the American Mathematical Society, volume 68, number 3, pages 337-404, 1950.