Reproducing kernel Hilbert space

From Wikipedia, the free encyclopedia

In functional analysis (a branch of mathematics), a reproducing kernel Hilbert space is a function space in which pointwise evaluation is a continuous linear functional. Equivalently, they are spaces that can be defined by reproducing kernels. The subject was originally and simultaneously developed by Nachman Aronszajn (1907-1980) and Stephan Bergman (1895-1987) in 1950.

In this article we assume that Hilbert spaces are complex. This is because many of the examples of reproducing kernel Hilbert spaces are spaces of analytic functions. Also recall the sesquilinearity convention: the inner product is linear in the second variable.

Let X be an arbitrary set and H a Hilbert space of complex-valued functions on X. H is a reproducing kernel Hilbert space iff the linear map

$f \mapsto f(x)$

from H to the complex numbers is continuous for any x in X. By the Riesz representation theorem, this implies that for given x there exists an element K_x of H with the property that:

$f(x) = \langle K_x, f \rangle \quad \forall f \in H \quad (*)$

The function

$K(x,y) \ \stackrel{\mathrm{def}}{=}\ K_x(y)$

is called a reproducing kernel for the Hilbert space. In fact, K is uniquely determined by the above condition (*).

For example, when X is finite and H consists of all complex-valued functions on X, then an element of H can be represented as an array of complex numbers. If the usual inner product is used, then K_x is the function whose value is 1 at x and 0 everywhere else.

In other contexts, (*) amounts to saying

$f(x)=\int_X K(x,y) f(y)\,dy$

for every f, where X is often the real numbers or Rⁿ.

1 Bergman kernel
2 Moore-Aronszajn theorem
3 See also
4 References

[edit] Bergman kernel

The Bergman kernel is defined for open sets D in Cⁿ. Take the Hilbert H space of square-integrable functions, for the Lebesgue measure on D, that are holomorphic functions. The theory is non-trivial in such cases as there are such functions, which are not identically zero. Then H is a reproducing kernel space, with kernel function the Bergman kernel; this example, with n = 1, was introduced by Bergman in 1922.

[edit] Moore-Aronszajn theorem

Given a positive semi-definite kernel $K$ , we can construct a unique RKHS $H$ with $K$ as the reproducing kernel. A positive semi-definite kernel is a function on $X \otimes X$ with the following property. For all natural number $n$ , for all $x_1, \ldots, x_n$ in $X$ , and for all $\alpha_1, \ldots, \alpha_n$ in a real or complex,

$\sum_{i=1}^n \sum_{j=1}^n \alpha_i \alpha_j K(x_i, x_j) \ge 0.$

Now, for all $x$ in $X$ define the following functions as the first class citizens of $H$

$f(x) = K(\cdot, x).$

Let $H'$ be the linear vector space spanned by the set $\{ f(x) \}_{x \in X}$ . Finally we complete $H'$ by including all the Cauchy sequences of $H'$ .