Concentration of measure

In mathematics, concentration of measure (about a median) is a principle that is applied in measure theory, probability and combinatorics, and has consequences for other fields such as Banach space theory. Informally, it states that "A random variable that depends in a Lipschitz way on many independent variables (but not too much on any of them) is essentially constant". [1]

The c.o.m. phenomenon was put forth in the early 1970s by Vitali Milman in his works on the local theory of Banach spaces, extending an idea going back to the work of Paul Lévy.[2][3] It was further developed in the works of Milman and Gromov, Maurey, Pisier, Shechtman, Talagrand, Ledoux, and others.

The general setting

Let (X, d, \mu) be a metric measure space, \mu(X) = 1. Let

\alpha(\epsilon) = \sup \left\{\mu( X \setminus A_\epsilon) \, | \, \mu(A) \geq 1/2 \right\},

where

A_\epsilon = \left\{ x \, | \, d(x, A) < \epsilon \right\}

is the \epsilon-extension of a set A.

The function \alpha(\cdot) is called the concentration rate of the space X. The following equivalent definition has many applications:

\alpha(\epsilon) = \sup \left\{ \mu( \{ F \geq \mathop{M} + \epsilon \}) \right\},

where the supremum is over all 1-Lipschitz functions F: X \to \mathbb{R}, and the median (or Levy mean) M = \mathop{Med} F is defined by the inequalities

\mu \{ F \geq M \} \geq 1/2, \, \mu \{ F \leq M \} \geq 1/2.

Informally, the space X exhibits a concentration phenomenon if \alpha(\epsilon) decays very fast as \epsilon grows. More formally, a family of metric measure spaces (X_n, d_n, \mu_n) is called a Lévy family if the corresponding concentration rates \alpha_n satisfy

\forall \epsilon > 0 \,\, \alpha_n(\epsilon) \to 0 {\rm \;as\; } n\to \infty,

and a normal Lévy family if

\forall \epsilon > 0 \,\, \alpha_n(\epsilon) \leq C \exp(-c n \epsilon^2)

for some constants c,C>0. For examples see below.

Concentration on the sphere

The first example goes back to Paul Lévy. According to the spherical isoperimetric inequality, among all subsets A of the sphere S^n with prescribed spherical measure \sigma_n(A), the spherical cap

\left\{ x \in S^n | \mathrm{dist}(x, x_0) \leq R \right\},

for suitable R, has the smallest \epsilon-extension A_\epsilon (for any \epsilon > 0).

Applying this to sets of measure \sigma_n(A) = 1/2 (where \sigma_n(S^n) = 1), one can deduce the following concentration inequality:

\sigma_n(A_\epsilon) \geq 1 - C \exp(- c n \epsilon^2) ,

where C,c are universal constants. Therefore (S^n)_n meet the definition above of a normal Lévy family.

Vitali Milman applied this fact to several problems in the local theory of Banach spaces, in particular, to give a new proof of Dvoretzky's theorem.

Other examples

Footnotes

  1. ↑ Michel Talagand, A New Look at Independence, The Annals of Probability, 1996, Vol. 24, No.1, 1-34
  2. ↑ "The concentration of f_\ast(\mu), ubiquitous in the probability theory and statistical mechanics, was brought to geometry (starting from Banach spaces) by Vitali Milman, following the earlier work by Paul Lévy" - M. Gromov, Spaces and questions, GAFA 2000 (Tel Aviv, 1999), Geom. Funct. Anal. 2000, Special Volume, Part I, 118–161.
  3. ↑ "The idea of concentration of measure (which was discovered by V.Milman) is arguably one of the great ideas of analysis in our times. While its impact on Probability is only a small part of the whole picture, this impact should not be ignored." - M. Talagrand, A new look at independence, Ann. Probab. 24 (1996), no. 1, 1–34.

Further reading