Berry–Esséen theorem

From Wikipedia, the free encyclopedia

The central limit theorem in probability theory and statistics states that under certain circumstances the sample mean, considered as a random quantity, becomes more normally distributed as the sample size is increased. The Berry–Esseen theorem, also known as the Berry–Esseen inequality, attempts to quantify the rate at which this convergence to normality takes place.

Statements of the theorem vary, as it was independently discovered by two mathematicians, Andrew C. Berry (in 1941) and Carl-Gustav Esseen (1942), who then, along with other authors, refined it repeatedly over subsequent decades.

One version, sacrificing generality somewhat for the sake of clarity, is the following:

Let X₁, X₂, ..., be i.i.d. random variables with E(X₁) = 0, E(X₁²) = σ² > 0, and E(|X₁|³) = ρ < $\infty$ . Also, let

$Y_n = {X_1 + X_2 + \ldots + X_n \over n}$

be the sample mean, with F_n the cdf of

${Y_n \sqrt{n} \over {\sigma}},$

and Φ the cdf of the standard normal distribution. Then there exists a positive constant C such that for all x and n,

$\left|F_n(x) - \Phi(x)\right| \le {C \rho \over \sigma^3\,\sqrt{n}}.$

Illustration of the difference in cumulative distribution functions alluded to in the theorem.

That is: given a sequence of Independent identically-distributed random variables, each having mean zero and positive variance, if additionally the third absolute moment is finite, then the cumulative distribution functions of the standardized sample mean and the standard normal distribution differ (vertically, on a graph) by no more than the specified amount. Note that the rate of convergence is on the order of n^−1/2.

Calculated values of the constant C have decreased markedly over the years, from 7.59 (Esseen's original bound) to 0.7975 in 1972 (by P. van Beeck). The best current bound is 0.7655 (by I. S. Shiganov in 1986).

[edit] See also

[edit] External links

Chen, Po-Ning (2002). Asymptotic Refinement of the Berry-Esseen Constant. A PDF file retrieved Mar. 9, 2004.
Gut, Allan & Holst Lars. Carl-Gustav Esseen, retrieved Mar. 15, 2004.

[edit] References

Durrett, Richard (1991). Probability: Theory and Examples. Pacific Grove, CA: Wadsworth & Brooks/Cole. ISBN 0-534-13206-5.
Feller, William (1972). An Introduction to Probability Theory and Its Applications, Volume II (2nd ed.). New York: John Wiley & Sons. ISBN 0-471-25709-5.
Manoukian, Edward B. (1986). Modern Concepts and Theorems of Mathematical Statistics. New York: Springer-Verlag. ISBN 0-387-96186-0.
Serfling, Robert J. (1980). Approximation Theorems of Mathematical Statistics. New York: John Wiley & Sons. ISBN 0-471-02403-1.