Pearson distribution

From Wikipedia, the free encyclopedia

This article or section is incomplete and may require expansion and/or cleanup.
Please improve the article, or discuss the issue on the talk page.

Diagram of the Pearson system, showing distributions of types I, III, VI, V, and IV in terms of

β 1

(squared skewness) and

β 2

(traditional kurtosis)

The Pearson distribution is a family of continuous probability distributions. It was first published by Karl Pearson in 1895 and subsequently extended by him in 1901 and 1916 in a series of articles on biostatistics.

1 History
2 Definition
- 2.1 Case 1, negative discriminant: The Pearson type IV distribution
  - 2.1.1 The Pearson type VII distribution
  - 2.1.2 Student's t-distribution
- 2.2 Case 2, non-negative discriminant
3 Relation to other distributions
4 Applications
5 Notes
6 Sources
- 6.1 Primary sources
- 6.2 Secondary sources

[edit] History

The Pearson system was originally devised in an effort to model visibly skewed observations. It was well known at the time how to adjust a theoretical model to fit the first two cumulants or moments of observed data: Any probability distribution can be extended straightforwardly to form a location-scale family. Except in pathological cases, a location-scale family can be made to fit the observed mean (first cumulant) and variance (second cumulant) arbitrarily well. However, it was not known how to construct probability distributions in which the skewness (standardized third cumulant) and kurtosis (standardized fourth cumulant) could be adjusted equally freely. This need became apparent when trying to fit known theoretical models to observed data that exhibited skewness. Pearson's examples include survival data, which are usually asymmetric.

In his original paper, Pearson (1895, p. 360) identified four types of distributions (numbered I through IV) in addition to the normal distribution (which was originally known as type V). The classification depended on whether the distributions were supported on a bounded interval, on a half-line, or on the whole real line; and whether they were potentially skewed or necessarily symmetric. A second paper (Pearson 1901) fixed two omissions: it redefined the type V distribution (originally just the normal distribution, but now the inverse-gamma distribution) and introduced the type VI distribution. Together the first two papers cover the five main types of the Pearson system (I, III, VI, V, and IV). In a third paper, Pearson (1916) introduced further special cases and subtypes (VII through XII).

Rhind (1909, pp. 430–432) devised a simple way of visualizing the parameter space of the Pearson system, which was subsequently adopted by Pearson (1916, plate 1 and pp. 430ff., 448ff.). The Pearson types are characterized by two quantities, commonly referred to as $β 1$ and $β 2$ . The first is the square of the skewness: $\beta_1 = \gamma_1^2$ where $γ 1$ is the skewness, or third standardized moment. The second is the traditional kurtosis, or fourth standardized moment: $β 2 = γ 2 + 3$ . (Modern treatments define kurtosis $γ 2$ in terms of cumulants instead of moments, so that for a normal distribution we have $γ 2 = 0$ and $β 2 = 3$ . Here we follow the historical precedent and use $β 2$ .) The diagram on the right shows which Pearson type a given concrete distribution (identified by a point $(β 1,β 2)$ ) belongs to.

Many of the skewed and/or non-mesokurtic distributions familiar to us today were still unknown in the early 1890s. What is now known as the beta distribution had been used by Thomas Bayes as a posterior distribution of the parameter of a Bernoulli distribution in his 1763 work on inverse probability. The Beta distribution gained prominence due to its membership in Pearson's system and was known until the 1940s as the Pearson type I distribution. ^[1] (Pearson's type II distribution is a special case of type I, but is usually no longer singled out.) The gamma distribution originated from Pearson's work (Pearson 1893, p. 331; Pearson 1895, pp. 357, 360, 373–376) and was known as the Pearson type III distribution, before acquiring its modern name in the 1930s and 1940s. ^[2] Pearson's 1895 paper introduced the type IV distribution, which contains Student's t-distribution as a special case, predating William Gosset's subsequent use by several years. His 1901 paper introduced the inverse-gamma distribution (type V) and the beta prime distribution (type VI).

[edit] Definition

A Pearson density p is defined to be any valid solution to the differential equation (cf. Pearson 1895, p. 381)

$\frac{p'(x)}{p(x)} + \frac{a+x-\lambda}{b_2 (x-\lambda)^2 + b_1 (x-\lambda) + b_0} = 0. \qquad (1) \!$

with : $b_0=\frac{4 \beta_2-3 \beta_1}{10 \beta_2 -12\beta_1 -18} \mu_2$

$a=b_1=\sqrt{\mu_2 \beta_1}\frac{\beta_2+3}{10 \beta2-12\beta_1 -18}$

$b_2=\frac{2 \beta_2-3 \beta_1 -6}{10 \beta2-12\beta_1 -18}$

The parameter a₀ determines a stationary point, and hence under some conditions a mode of the distribution, since

$p'(a_0) = 0 \!$

follows directly from the differential equation.

Since we are confronted with a linear differential equation with variable coefficients, its solution is straightforward:

$p(x) \propto \exp\left( -\!\int\!\!\frac{x-a}{b_2 x^2 + b_1 x + b_0} \,\mathrm{d}x \right). \!$

The integral in this solution simplifies considerably when certain special cases of the integrand are considered. Pearson (1895, p. 367) distinguished two main cases, determined by the sign of the discriminant (and hence the number of real roots) of the quadratic function

$f(x) = b_2\,x^2 + b_1\,x + b_0. \qquad (2)\!$

[edit] Case 1, negative discriminant: The Pearson type IV distribution

If the discriminant of the quadratic function (2) is negative ( $b_1^2 - 4 b_2 b_0 < 0$ ), it has no real roots. Then define

$y = x + \frac{b_1}{2\,b_2} \!$ and

$\alpha = \frac{\sqrt{4\,b_2\,b_0 - b_1^2\,}}{2\,b_2}. \!$

Observe that $α$ is a well-defined real number and $\alpha \neq 0$ , because by assumption $4 b_2 b_0 - b_1^2 > 0$ and therefore $b_2 \neq 0$ . Applying these substitutions, the quadratic function (2) is transformed into

$f(x) = b_2\,(y^2 + \alpha^2). \!$

The absence of real roots is obvious from this formulation, because $α 2$ is necessarily positive.

We now express the solution to the differential equation (1) as a function of y:

$p(y) \propto \exp\left(- \frac{1}{b_2}\, \int\frac{y - \frac{b_1}{2\,b_2} - a}{y^2 + \alpha^2} \,\mathrm{d}y \right). \!$

Pearson (1895, p. 362) called this the "trigonometrical case", because the integral

$\int\frac{y - \frac{2\,b_2\,a + b_1}{2\,b_2}}{y^2 + \alpha^2} \,\mathrm{d}y = \frac{1}{2} \ln(y^2 + \alpha^2) - \frac{2\,b_2\,a + b_1}{2\,b_2\,\alpha} \arctan\left(\frac{y}{\alpha}\right) + C_0 \!$

involves the inverse trigonometic arctan function. Then

$p(y) \propto \exp\left[ -\frac{1}{2\,b_2} \ln\!\left(1+\frac{y^2}{\alpha^2}\right) -\frac{\ln\alpha}{2\,b_2} +\frac{2\,b_2\,a + b_1}{2\,b_2^2\,\alpha} \arctan\left(\frac{y}{\alpha}\right) + C_1 \right] \!$

Finally, let

$m = \frac{1}{2\,b_2} \!$ and

$\nu = -\frac{2\,b_2\,a + b_1}{2\,b_2^2\,\alpha} \!$

Applying these substitutions, we obtain the parametric function:

$p(y) \propto \left[1 + \frac{y^2}{\alpha^2}\right]^{-m} \exp\left[-\nu \arctan\left(\frac{y}{\alpha}\right)\right] \!$

This unnormalized density has support on the entire real line. It depends on a scale parameter $α > 0$ and shape parameters $m > 1 / 2$ and $ν$ . One parameter was lost when we chose to find the solution to the differential equation (1) as a function of y rather than x. We therefore reintroduce a fourth parameter, namely the location parameter λ. We have thus derived the density of the Pearson type IV distribution:

$p(x) = \frac{\left|\frac{\Gamma\!\left(m+\frac{\nu}{2}i\right)}{\Gamma(m)}\right|^2} {\alpha\,\mathrm{\Beta}\!\left(m-\frac12, \frac12\right)} \left[1 + \left(\frac{x-\lambda}{\alpha}\right)^{\!2\,} \right]^{-m} \exp\left[-\nu \arctan\left(\frac{x-\lambda}{\alpha}\right)\right]. \!$

The normalizing constant involves the complex Gamma function (Γ) and the Beta function (B).

[edit] The Pearson type VII distribution

Plot of Pearson type VII densities with

λ = 0

σ = 1

, and: $\gamma_2=\infty$ (red);

γ 2 = 4

(blue); and

γ 2 = 0

(black)

The shape parameter ν of the Pearson type IV distribution controls its skewness. If we fix its value at zero, we obtain a symmetric three-parameter family. This special case is known as the Pearson type VII distribution (cf. Pearson 1916, p. 450). Its density is

$p(x) = \frac{1}{\alpha\,\mathrm{\Beta}\!\left(m-\frac12, \frac12\right)} \left[1 + \left(\frac{x-\lambda}{\alpha}\right)^{\!2\,} \right]^{-m}, \!$

where B is the Beta function.

An alternative parameterization (and slight specialization) of the type VII distribution is obtained by letting

$\alpha = \sigma\,\sqrt{2\,m-3}, \!$

which requires $m > 3 / 2$ . This entails a minor loss of generality but ensures that the variance of the distribution exists and is equal to $σ 2$ . Now the parameter m only controls the kurtosis of the distribution. If m approaches infinity as λ and σ are held constant, the normal distribution arises as a special case:

$\lim_{m\to\infty} \frac{1}{\sigma\,\sqrt{2\,m-3}\,\mathrm{\Beta}\!\left(m-\frac12, \frac12\right)} \left[1 + \left(\frac{x-\lambda}{\sigma\,\sqrt{2\,m-3}}\right)^{\!2\,} \right]^{-m} \!$

$= \frac{1}{\sigma\,\sqrt{2}\,\Gamma\!\left(\frac12\right)} \times \lim_{m\to\infty} \frac{\Gamma(m)}{\Gamma\!\left(m-\frac12\right) \sqrt{m-\frac32}} \times \lim_{m\to\infty} \left[1 + \frac{\left(\frac{x-\lambda}{\sigma}\right)^2}{2\,m-3} \right]^{-m} \!$

$= \frac{1}{\sigma\sqrt{2\,\pi}} \times 1 \times \exp\!\left[-\frac12 \left(\frac{x-\lambda}{\sigma}\right)^{\!2\,} \right] \!$

This is the density of a normal distribution with mean λ and standard deviation σ.

It is convenient to require that $m > 5 / 2$ and to let

$m = \frac52 + \frac{3}{\gamma_2}. \!$

This is another specialization, and it guarantees that the first four moments of the distribution exist. More specifically, the Pearson type VII distribution parameterized in terms of $(λ,σ,γ 2)$ has a mean of λ, standard deviation of σ, skewness of zero, and excess kurtosis of $γ 2$ .

[edit] Student's t-distribution

The Pearson type VII distribution subsumes Student's t-distribution, and hence also the Cauchy distribution. Student's t-distribution arises as the result of applying the following substitutions to its original parameterization:

$\lambda = 0, \!$

$\alpha = \sqrt{\nu}, \!$ and

$m = \frac{\nu+1}{2}, \!$

where $ν > 0$ . Observe that the constraint $m > 1 / 2$ is satisfied. The density of this restricted one-parameter family is

$p(x) = \frac{1}{\sqrt{\nu}\,\mathrm{\Beta}\!\left(\frac{\nu}{2}, \frac12\right)} \left[1 + \frac{x^2}{\nu} \right]^{-\frac{\nu+1}{2}}, \!$

which is easily recognized as the density of Student's t-distribution.

[edit] Case 2, non-negative discriminant

If the quadratic function (2) has a non-negative discriminant ( $b_1^2 - 4 b_2 b_0 \geq 0$ ), it has real roots a₁ and a₂ (not necessarily distinct):

$a_1 = \frac{-b_1 - \sqrt{b_1^2 - 4 b_2 b_0}}{2 b_2}, \!$

$a_2 = \frac{-b_1 + \sqrt{b_1^2 - 4 b_2 b_0}}{2 b_2}, \!$

One have to define :

$m_1=\frac{a+a_1}{c_2 (a_2-a_1)} \!$

$m_2=-\frac{a+a_2}{c_2 (a_2-a_1)}\!$

$C_1=\frac{c_1}{2 c_2}\!$

In the presence of real roots the quadratic function (2) can be written as

$f(x) = b_2\,(x-a_1)(x-a_2), \!$

and the solution to the differential equation is therefore

$p(x) \propto \exp\left( -\frac{1}{b_2} \int\!\!\frac{x-a}{(x - a_1) (x - a_2)} \,\mathrm{d}x \right). \!$

Pearson (1895, p. 362) called this the "logarithmic case", because the integral

$\int\!\!\frac{x-a}{(x - a_1) (x - a_2)} \,\mathrm{d}x = \frac{(a_1-a)\ln(x-a_1) - (a_2-a)\ln(x-a_2)}{a_1-a_2} + C \!$

involves only the logarithm function, and not the arctan function as in the previous case.

Using the substitution

$\nu = \frac{1}{b_2\,(a_1-a_2)} \!$

we obtain the following solution to the differential equation (1):

$p(x) \propto (x-r_1)^{-\nu (a_1-a)} (x-a_2)^{\nu (a_2-a)}. \!$

Since this density is only known up to a hidden constant of proportionality, that constant can be changed and the density written as follows:

$p(x) \propto \left(1-\frac{x}{a_1}\right)^{-\nu (a_1-a)} \left(1-\frac{x}{a_2}\right)^{ \nu (a_2-a)} \!$

[edit] The Pearson type I and type II distribution

Please help improve this article or section by expanding it.
Further information might be found on the talk page or at requests for expansion. (July 2007)

The Pearson type I distribution (a generalization of the beta distribution) arises when the roots of the quadratic equation (2) are of opposite sign, that is, $r 1 < 0 < r 2$ . Then the solution p is supported on the interval $(r 1, r 2)$ . Apply the substition

$x = a_1 + y (a_2 - a_1) \qquad \mbox{where}\ 0<y<1, \!$

which yields a solution in terms of y that is supported on the interval $(0,1)$ :

$p(y) \propto \left(\frac{a_1-a_2}{a_1}\;y\right)^{(-a_1+a)\nu} \left(\frac{a_2-a_1}{a_2}\;(1-y)\right)^{(a_2-a)\nu}. \!$

Regrouping constants and parameters, this simplifies to:

$p(y) \propto y^{m_1} (1-y)^{m_2}, \!$

Thus $\frac{x-\lambda-a_1}{a_2-a_1}\!$ follows a $beta(m_1+1,m_2+1)\!$ with $\lambda=\mu_1- (a_2-a_1) \frac{m_1+1}{m_1+m_2+2}-a_1 \!$

It turns out that $m_1>-1 \land m_2>-1$ is necessary and sufficient for p to be a proper probability density function.

[edit] The Pearson type II distribution

The Pearson type II distribution is a special case of the Pearson type I family restricted to symmetric distributions.

For the Pearson Type II Curve ^[3] ,

$y = y_{0}\left(1-\frac{x^2}{a^2}\right)^m$

where

$x = \sum d^2/2 -(n^3-n)/12$

the ordinate, y, is the frequency of $\sum d^2$ . The Pearson Type II Curve is used in computing the table of significant correlation coefficients for Spearman's rank correlation coefficient when the number of items in a series is less than 100 (or 30, depending on some sources). After that, the distribution mimics a standard Student's t-distribution. For the table of values, certain values are used as the constants in the previous equation:

$m = \frac{5\beta_{2}-9}{2(3-\beta_{2})}$

$a^2 = \frac{2\mu_{2}\beta_{2}}{3-\beta_{2}}$

$y_{0} = \frac{N[\Gamma(2m+2)]}{a[2^{2m+1}][\Gamma(m+1)]}$

The moments of x used are

μ 2 = (n - 1)[(n 2 + n) / 12] 2

$\beta_{2}=\frac{3(25n^4-13n^3-73n^2+37n+72)}{25n(n+1)^2(n-1)}$

[edit] The Pearson type III distribution

$\lambda= \mu1 + \frac{b_0}{b_1} - (m+1) b_1\!$

$b_0+b_1 (x-\lambda)\!$ follows a : $gamma(m+1,b_1^2)\!$

Pearson type III distribution gamma distribution, chi-square distribution

[edit] The Pearson type V distribution

$\lambda=\mu_1-\frac{a-C_1} {1-2 b_2}\!$

$x-\lambda\!$ follows a : $inversegamma(\frac{1}{b_2}-1,\frac{a-C_1}{b_2})\!$

Pearson type V distribution inverse-gamma distribution

[edit] The Pearson type VI distribution

$\lambda=\mu_1 + (a_2-a_1) \frac{m_2+1}{m_2+m_1+2} - a_2\!$

$\frac{x-\lambda-a_2}{a_2-a_1}\!$ follows a : $betaprime(m_2+1,-m_2-m_1-1)\!$

Pearson type VI distribution beta prime distribution, F-distribution

[edit] Relation to other distributions

The Pearson family subsumes the following distributions, among others:

beta distribution (type I)
beta prime distribution (type VI)
Cauchy distribution (type IV)
chi-square distribution (type III)
continuous uniform distribution (limit of type I)
exponential distribution (type III)
gamma distribution (type III)
F-distribution (type VI)
inverse-chi-square distribution (type V)
inverse-gamma distribution (type V)
normal distribution (limit of type I, III, IV, V, or VI)
Student's t-distribution (type IV)

[edit] Applications

These models are used in financial markets, given their ability to be parametrised in a way that has intuitive meaning for market traders. A number of models are in current use that capture the stochastic nature of the volatility of rates, stocks etc. and this family of distributions may prove to be one of the more important.

In the United States, the Log-Pearson III is the default distribution for flood frequency analysis.

[edit] Notes

^ Miller, Jeff; et al. (2006-07-09). Beta distribution. Earliest Known Uses of Some of the Words of Mathematics. Retrieved on December 9, 2006.
^ Miller, Jeff; et al. (2006-12-07). Gamma distribution. Earliest Known Uses of Some of the Words of Mathematics. Retrieved on December 9, 2006.
^ Ramsey, Philip H. (1989-09-01). Critical Values for Spearman's Rank Order Correlation. Retrieved on August 22, 2007.

[edit] Sources

[edit] Primary sources

Pearson, Karl (1893). "Contributions to the mathematical theory of evolution [abstract]". Proceedings of the Royal Society of London 54: 329–333. doi:10.1098/rspl.1893.0079.

Pearson, Karl (1895). "Contributions to the mathematical theory of evolution, II: Skew variation in homogeneous material". Philosophical Transactions of the Royal Society of London. A 186: 343–414. doi:10.1098/rsta.1895.0010.

Pearson, Karl (1901). "Mathematical contributions to the theory of evolution, X: Supplement to a memoir on skew variation". Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character 197: 443–459. doi:10.1098/rsta.1901.0023.

Pearson, Karl (1916). "Mathematical contributions to the theory of evolution, XIX: Second supplement to a memoir on skew variation". Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character 216: 429–457. doi:10.1098/rsta.1916.0009.

Rhind, A. (July/October 1909). "Tables to facilitate the computation of the probable errors of the chief constants of skew frequency distributions". Biometrika 7 (1/2): 127–147.

[edit] Secondary sources

Milton Abramowitz and Irene A. Stegun (1964). Handbook of Mathematical Functions with Formulas, Graphs, and Mathematical Tables. National Bureau of Standards.

Eric W. Weisstein et al. Pearson Type III Distribution. From MathWorld.

v • d • e

Probability distributions

Discrete univariate with finite support

Benford · Bernoulli · binomial · categorical · hypergeometric · Rademacher · discrete uniform · Zipf · Zipf-Mandelbrot

Discrete univariate with infinite support

Boltzmann · Conway-Maxwell-Poisson · compound Poisson · discrete phase-type · extended negative binomial · Gauss-Kuzmin · geometric · logarithmic · negative binomial · parabolic fractal · Poisson · Skellam · Yule-Simon · zeta

Continuous univariate supported on a bounded interval

Beta · Kumaraswamy · raised cosine · triangular · U-quadratic · uniform · Wigner semicircle

Continuous univariate supported on a semi-infinite interval

Beta prime · Burr · chi-square · Coxian · Erlang · exponential · F · Fermi-Dirac · folded normal · Fréchet · Gamma · generalized extreme value · generalized inverse Gaussian · half-logistic · half-normal · Hotelling's T-square · hyper-exponential · hypoexponential · inverse chi-square (scale inverse chi-square) · inverse Gaussian · inverse gamma · Lévy · log-normal · log-logistic · Maxwell-Boltzmann · Maxwell speed · Nakagami · noncentral chi-square · Pareto · phase-type · Rayleigh · relativistic Breit–Wigner · Rice · Rosin–Rammler · shifted Gompertz · truncated normal · type-2 Gumbel · Weibull · Wilks' lambda

Continuous univariate supported on the whole real line

Cauchy · extreme value · exponential power · Fisher's z · Fisher-Tippett · generalized hyperbolic · hyperbolic secant · Landau · Laplace · Lévy skew alpha-stable · logistic · normal (Gaussian) · normal inverse Gaussian · skew normal · Student's t · type-1 Gumbel · Variance-Gamma · Voigt

Multivariate (joint)

Discrete: Ewens · multinomial · multivariate Polya Continuous: Dirichlet · Generalized Dirichlet · multivariate normal · multivariate Student · normal-scaled inverse gamma · normal-gamma Matrix-valued: inverse-Wishart · matrix normal · Wishart

Directional, degenerate, and singular

Directional: Kent · von Mises · von Mises–Fisher Degenerate: discrete degenerate · Dirac delta function Singular: Cantor

Families

exponential · natural exponential · location-scale · maximum entropy · Pearson · Tweedie

Categories: Continuous distributions | Systems of probability distributions

Hidden categories: Wikipedia articles needing clarification | Articles to be expanded since July 2007 | All articles to be expanded