Skewness

Example distribution with non-zero (positive) skewness. These data are from experiments on wheat grass growth.

In probability theory and statistics, skewness is a measure of the asymmetry of the probability distribution of a real-valued random variable about its mean. The skewness value can be positive or negative, or undefined.

The qualitative interpretation of the skew is complicated and unintuitive. Skew does not refer to the direction the curve appears to be leaning; in fact, the opposite is true. For a unimodal distribution, negative skew indicates that the tail on the left side of the probability density function is longer or fatter than the right side – it does not distinguish these two kinds of shape. Conversely, positive skew indicates that the tail on the right side is longer or fatter than the left side. In cases where one tail is long but the other tail is fat, skewness does not obey a simple rule. For example, a zero value means that the tails on both sides of the mean balance out overall; this is the case for a symmetric distribution, but is also true for an asymmetric distribution where the asymmetries even out, such as one tail being long but thin, and the other being short but fat. Further, in multimodal distributions and discrete distributions, skewness is also difficult to interpret. Importantly, the skewness does not determine the relationship of mean and median. In cases where it is necessary, data might be transformed to have a normal distribution.

Introduction

Consider the two distributions in the figure just below. Within each graph, the values on the right side of the distribution taper differently from the values on the left side. These tapering sides are called tails, and they provide a visual means to determine which of the two kinds of skewness a distribution has:

negative skew: The left tail is longer; the mass of the distribution is concentrated on the right of the figure. The distribution is said to be left-skewed, left-tailed, or skewed to the left, despite the fact that the curve itself appears to be skewed or leaning to the right; left instead refers to the left tail being drawn out and, often, the mean being skewed to the left of a typical center of the data. A left-skewed distribution usually appears as a right-leaning curve.^[1]
positive skew: The right tail is longer; the mass of the distribution is concentrated on the left of the figure. The distribution is said to be right-skewed, right-tailed, or skewed to the right, despite the fact that the curve itself appears to be skewed or leaning to the left; right instead refers to the right tail being drawn out and, often, the mean being skewed to the right of a typical center of the data. A right-skewed distribution usually appears as a left-leaning curve.^[1]

Skewness in a data series may sometimes be observed not only graphically but by simple inspection of the values. For instance, consider the numeric sequence (49, 50, 51), whose values are evenly distributed around a central value of 50. We can transform this sequence into a negatively skewed distribution by adding a value far below the mean, e.g. (40, 49, 50, 51). Similarly, we can make the sequence positively skewed by adding a value far above the mean, e.g. (49, 50, 51, 60).

Relationship of mean and median

The skewness is not directly related to the relationship between the mean and median: a distribution with negative skew can have its mean greater than or less than the median, and likewise for positive skew.

In the older notion of nonparametric skew, defined as $(\mu -\nu )/\sigma ,$ where µ is the mean, ν is the median, and σ is the standard deviation, the skewness is defined in terms of this relationship: positive/right nonparametric skew means the mean is greater than (to the right of) the median, while negative/left nonparametric skew means the mean is less than (to the left of) the median. However, the modern definition of skewness and the traditional nonparametric definition do not in general have the same sign: while they agree for some families of distributions, they differ in general, and conflating them is misleading.

If the distribution is symmetric, then the mean is equal to the median, and the distribution has zero skewness.^[2] If, in addition, the distribution is unimodal, then the mean = median = mode. This is the case of a coin toss or the series 1,2,3,4,... Note, however, that the converse is not true in general, i.e. zero skewness does not imply that the mean is equal to the median.

Paul T. von Hippel points out: "Many textbooks, teach a rule of thumb stating that the mean is right of the median under right skew, and left of the median under left skew. This rule fails with surprising frequency. It can fail in multimodal distributions, or in distributions where one tail is long but the other is heavy. Most commonly, though, the rule fails in discrete distributions where the areas to the left and right of the median are not equal. Such distributions not only contradict the textbook relationship between mean, median, and skew, they also contradict the textbook interpretation of the median."^[3]

Definition

Pearson's moment coefficient of skewness

The skewness of a random variable X is the third standardized moment γ₁, defined as:^[4]^[5]

 $\gamma _{1}=\operatorname {E} \left[\left({\frac {X-\mu }{\sigma }}\right)^{3}\right]={\frac {\mu _{3}}{\sigma ^{3}}}={\frac {\operatorname {E} \left[(X-\mu )^{3}\right]}{\ \ \ (\operatorname {E} \left[(X-\mu )^{2}\right])^{3/2}}}={\frac {\kappa _{3}}{\kappa _{2}^{3/2}}}$

where μ is the mean, σ is the standard deviation, E is the expectation operator, μ₃ is the third central moment, and κ_t are the t^th cumulants. It is sometimes referred to as Pearson's moment coefficient of skewness,^[5] or simply the moment coefficient of skewness,^[4] but should not be confused with Pearson's other skewness statistics (see below). The last equality expresses skewness in terms of the ratio of the third cumulant κ₃ to the 1.5th power of the second cumulant κ₂. This is analogous to the definition of kurtosis as the fourth cumulant normalized by the square of the second cumulant. The skewness is also sometimes denoted Skew[X].

Skewness can be expressed in terms of the non-central moment E[X³] by expanding the previous formula,

{\begin{aligned}\gamma _{1}&=\operatorname {E} \left[\left({\frac {X-\mu }{\sigma }}\right)^{3}\right]\\&={\frac {\operatorname {E} [X^{3}]-3\mu \operatorname {E} [X^{2}]+3\mu ^{2}\operatorname {E} [X]-\mu ^{3}}{\sigma ^{3}}}\\&={\frac {\operatorname {E} [X^{3}]-3\mu (\operatorname {E} [X^{2}]-\mu \operatorname {E} [X])-\mu ^{3}}{\sigma ^{3}}}\\&={\frac {\operatorname {E} [X^{3}]-3\mu \sigma ^{2}-\mu ^{3}}{\sigma ^{3}}}.\end{aligned}}

Examples

Skewness can be infinite, as when

\Pr \left[ X > x \right]=x^{-2}\mbox{ for }x>1,\ \Pr[X<1]=0

where the third cumulants are infinite, or as when

\Pr[X<x]=(1-x)^{-3}/2{\mbox{ for negative }}x{\mbox{ and }}\Pr[X>x]=(1+x)^{-3}/2{\mbox{ for positive }}x.

where the third cumulant is undefined.

Properties

Starting from a standard cumulant expansion around a normal distribution, one can show that

skewness = 6 (mean − median)/standard deviation (1 + kurtosis/8) + O (skewness²).

If Y is the sum of n independent and identically distributed random variables, all with the distribution of X, then the third cumulant of Y is n times that of X and the second cumulant of Y is n times that of X, so ${\mbox{Skew}}[Y]={\mbox{Skew}}[X]/{\sqrt {n}}$ . This shows that the skewness of the sum is smaller, as it approaches a Gaussian distribution in accordance with the central limit theorem. Note that the assumption that the variables be independent for the above formula is very important because it is possible even for the sum of two Gaussian variables to have a skewed distribution (see this example).

Sample skewness

For a sample of n values, a natural method of moments estimator of the population skewness is^[6]

b_{1}={\frac {m_{3}}{s^{3}}}={\frac {{\tfrac {1}{n}}\sum _{i=1}^{n}(x_{i}-{\overline {x}})^{3}}{{\sqrt {{\tfrac {1}{n-1}}\sum _{i=1}^{n}(x_{i}-{\overline {x}})^{2}}}^{\,3}}}={\frac {{\tfrac {1}{n}}\sum _{i=1}^{n}(x_{i}-{\overline {x}})^{3}}{\left[{\tfrac {1}{n-1}}\sum _{i=1}^{n}(x_{i}-{\overline {x}})^{2}\right]^{3/2}}}\ ,

where ${\overline {x}}$ is the sample mean, s is the sample standard deviation, and the numerator m₃ is the sample third central moment.

Another common definition of the sample skewness is^[6]

G_{1}={\frac {k_{3}}{k_{2}^{3/2}}}={\frac {n^{2}}{(n-1)(n-2)}}\;{\frac {m_{3}}{s^{3}}},

where $k_{3}$ is the unique symmetric unbiased estimator of the third cumulant and $k_{2}=s^{2}$ is the symmetric unbiased estimator of the second cumulant (i.e. the variance).

In general, the ratios $b_{1}$ and $G_{1}$ are both biased estimators of the population skewness $\gamma _{1}$ ; their expected values can even have the opposite sign from the true skewness. (For instance, a mixed distribution consisting of very thin Gaussians centred at −99, 0.5, and 2 with weights 0.01, 0.66, and 0.33 has a skewness of about −9.77, but in a sample of 3, $G_{1}$ has an expected value of about 0.32, since usually all three samples are in the positive-valued part of the distribution, which is skewed the other way.) Nevertheless, $b_{1}$ and $G_{1}$ each have obviously the correct expected value of zero for any symmetric distribution with a finite third moment, including a normal distribution.

Under the assumption that the underlying random variable $X$ is normally distributed, it can be shown that ${\sqrt {n}}b_{1}{\xrightarrow {d}}N(0,6)$ . The variance of the skewness of a random sample of size n from a normal distribution is^[7]^[8]

\operatorname {var} (G_{1})={\frac {6n(n-1)}{(n-2)(n+1)(n+3)}}.

An approximate alternative is 6/n, but this is inaccurate for small samples.

In normal samples, $b_{1}$ has the smaller variance of the two estimators, with

\operatorname {var} (b_{1})<\operatorname {var} \left({\frac {m_{3}}{m_{2}^{3/2}}}\right)<\operatorname {var} (G_{1}),

where m₂ in the denominator is the (biased) sample second central moment.^[6]

The adjusted Fisher–Pearson standardized moment coefficient $G_{1}$ is the version found in Excel and several statistical packages including Minitab, SAS and SPSS.^[9]

Applications

Skewness has benefits in many areas. Many models assume normal distribution; i.e., data are symmetric about the mean. The normal distribution has a skewness of zero. But in reality, data points may not be perfectly symmetric. So, an understanding of the skewness of the dataset indicates whether deviations from the mean are going to be positive or negative.

D'Agostino's K-squared test is a goodness-of-fit normality test based on sample skewness and sample kurtosis.

Other measures of skewness

Comparison of mean, median and mode of two log-normal distributions with different skewnesses.

Other measures of skewness have been used, including simpler calculations suggested by Karl Pearson^[10] (not to be confused with Pearson's moment coefficient of skewness, see above). These other measures are:

Pearson's first skewness coefficient (mode skewness)

The Pearson mode skewness,^[11] or first skewness coefficient, is defined as

mean − mode/standard deviation.

Pearson's second skewness coefficient (median skewness)

The Pearson median skewness, or second skewness coefficient,^[12]^[13] is defined as

3 (mean − median)/standard deviation.

The latter is a simple multiple of the nonparametric skew.

Quantile-based measures

Bowley's measure of skewness (from 1901),^[14]^[15] also called Yule's coefficient (from 1912)^[16]^[17] is defined as:

B_{1}={\frac {{{Q}_{3}}+{{Q}_{1}}-2{{Q}_{2}}}{{{Q}_{3}}-{{Q}_{1}}}}

When writing it as ${\frac {{\frac {{{Q}_{3}}+{{Q}_{1}}}{2}}-{{Q}_{2}}}{\frac {{{Q}_{3}}-{{Q}_{1}}}{2}}}$ , it is easier to see that the numerator is the average of the upper and lower quartiles (a measure of location) minus the median while the denominator is (Q3-Q1)/2 which (for symmetric distributions) is the MAD measure of dispersion.

Other names for this measure are Galton's measure of skewness,^[18] the Yule–Kendall index^[19] and the quartile skewness ,

A more general formulation of a skewness function was described by Groeneveld, R. A. and Meeden, G. (1984):^[20]^[21]^[22]

\gamma (u)={\frac {F^{-1}(u)+F^{-1}(1-u)-2F^{-1}(1/2)}{F^{-1}(u)-F^{-1}(1-u)}}

where F is the cumulative distribution function. This leads to a corresponding overall measure of skewness^[21] defined as the supremum of this over the range 1/2 ≤ u < 1. Another measure can be obtained by integrating the numerator and denominator of this expression.^[20] The function γ(u) satisfies −1 ≤ γ(u) ≤ 1 and is well defined without requiring the existence of any moments of the distribution.^[20]

Bowley's measure of skewness is γ(u) evaluated at u = 3/4. Kelley's measure of skewness uses u = 0.1.

Groeneveld & Meeden’s coefficient

Groeneveld & Meeden have suggested, as an alternative measure of skewness,^[20]

B_{3}=\mathrm {skew} (X)={\frac {(\mu -\nu )}{E(|X-\nu |)}},

where μ is the mean, ν is the median, |…| is the absolute value, and E() is the expectation operator. This is closely related in form to Pearson's second skewness coefficient.

L-moments

Use of L-moments in place of moments provides a measure of skewness known as the L-skewness.^[23]

Distance skewness

A value of skewness equal to zero does not imply that the probability distribution is symmetric. Thus there is a need for another measure of asymmetry that has this property: such a measure was introduced in 2000.^[24] It is called distance skewness and denoted by dSkew. If X is a random variable taking values in the d-dimensional Euclidean space, X has finite expectation, X' is an independent identically distributed copy of X, and $\|\cdot \|$ denotes the norm in the Euclidean space, then a simple measure of asymmetry is

\operatorname {dSkew} (X):=1-{\frac {\operatorname {E} \|X-X'\|}{\operatorname {E} \|X+X'\|}}{\text{ if }}\Pr(X=0)\neq 1

and dSkew(X) := 0 for X = 0 (with probability 1). Distance skewness is always between 0 and 1, equals 0 if and only if X is diagonally symmetric (X and −X have the same probability distribution) and equals 1 if and only if X is a nonzero constant with probability one.^[25] Thus there is a simple consistent statistical test of diagonal symmetry based on the sample distance skewness:

\operatorname {dSkew} _{n}(X):=1-{\frac {\sum _{i,j}\|x_{i}-x_{j}\|}{\sum _{i,j}\|x_{i}+x_{j}\|}}.

Medcouple

The medcouple is a scale-invariant robust measure of skewness, with a breakdown point of 25%.^[26] It is the median of the values of the kernel function

h(x_{i},x_{j})={\frac {(x_{i}-x_{m})-(x_{m}-x_{j})}{x_{i}-x_{j}}}

taken over all couples $(x_{i},x_{j})$ such that $x_{i}\geq x_{m}\geq x_{j}$ , where $x_{m}$ is the median of the sample $\{x_{1},x_{2},\ldots ,x_{n}\}$ . It can be seen as the median of all possible quantile skewness measures.

Notes

1 2 Susan Dean, Barbara Illowsky "Descriptive Statistics: Skewness and the Mean, Median, and Mode", Connexions website
↑ "1.3.5.11. Measures of Skewness and Kurtosis". NIST. Retrieved 18 March 2012.
↑ von Hippel, Paul T. (2005). "Mean, Median, and Skew: Correcting a Textbook Rule". Journal of Statistics Education. 13 (2).
1 2 "Measures of Shape: Skewness and Kurtosis", 2008–2016 by Stan Brown, Oak Road Systems
1 2 Pearson's moment coefficient of skewness, FXSolver.com
1 2 3 Joanes, D. N.; Gill, C. A. (1998). "Comparing measures of sample skewness and kurtosis". Journal of the Royal Statistical Society (Series D): The Statistician. 47 (1): 183–189. doi:10.1111/1467-9884.00122.
↑ Duncan Cramer (1997) Fundamental Statistics for Social Research. Routledge. ISBN 9780415172042 (p 85)
↑ Kendall, M.G.; Stuart, A. (1969) The Advanced Theory of Statistics, Volume 1: Distribution Theory, 3rd Edition, Griffin. ISBN 0-85264-141-9 (Ex 12.9)
↑ Doane DP, Seward LE (2011) J Stat Educ 19 (2)
↑ http://www.stat.upd.edu.ph/s114%20cnotes%20fcapistrano/Chapter%2010.pdf
↑ Weisstein, Eric W. "Pearson Mode Skewness". MathWorld.
↑ Weisstein, Eric W. "Pearson's skewness coefficients". MathWorld.
↑ Doane, David P., and Lori E. Seward. "Measuring Skewness: A Forgotten Statistic?" Journal of Statistics Education 19.2 (2011): 1-18.
↑ Bowley, A. L. (1901). Elements of Statistics, P.S. King & Son, Laondon. Or in a later edition: BOWLEY, AL. "Elements of Statistics, 4th Edn (New York, Charles Scribner)."(1920).
↑ Kenney JF and Keeping ES (1962) Mathematics of Statistics, Pt. 1, 3rd ed., Van Nostrand, (page 102).
↑ Yule, George Udny. An introduction to the theory of statistics. C. Griffin, limited, 1912.
↑ Groeneveld, Richard A. "An influence function approach to describing the skewness of a distribution." The American Statistician 45.2 (1991): 97-102.
↑ Johnson et al (1994) p 3, p 40
↑ Wilks DS (1995) Statistical Methods in the Atmospheric Sciences, p 27. Academic Press. ISBN 0-12-751965-3
1 2 3 4 Groeneveld, R.A.; Meeden, G. (1984). "Measuring Skewness and Kurtosis". The Statistician. 33 (4): 391–399. JSTOR 2987742. doi:10.2307/2987742.
1 2 MacGillivray (1992)
↑ Hinkley DV (1975) "On power transformations to symmetry", Biometrika, 62, 101–111
↑ Hosking, J.R.M. (1992). "Moments or L moments? An example comparing two measures of distributional shape". The American Statistician. 46 (3): 186–189. JSTOR 2685210. doi:10.2307/2685210.
↑ Szekely, G.J. (2000). "Pre-limit and post-limit theorems for statistics", In: Statistics for the 21st Century (eds. C. R. Rao and G. J. Szekely), Dekker, New York, pp. 411–422.
↑ Szekely, G. J. and Mori, T. F. (2001) "A characteristic measure of asymmetry and its application for testing diagonal symmetry", Communications in Statistics – Theory and Methods 30/8&9, 1633–1639.
↑ G. Brys; M. Hubert; A. Struyf (November 2004). "A Robust Measure of Skewness". Journal of Computational and Graphical Statistics. 13 (4): 996–1017. doi:10.1198/106186004X12632.

Premaratne, G., Bera, A. K. (2001).

Adjusting the Tests for Skewness and Kurtosis for Distributional Misspecifications. Working Paper Number 01-0116, University of Illinois. Forthcoming in Comm in Statistics, Simulation and Computation.2016 1-15

Premaratne, G., Bera, A. K. (2000). Modeling Asymmetry and Excess Kurtosis in Stock Return Data. Office of Research Working Paper Number 00-0123, University of Illinois

References

Johnson, NL, Kotz, S, Balakrishnan N (1994) Continuous Univariate Distributions, Vol 1, 2nd Edition Wiley ISBN 0-471-58495-9
MacGillivray, HL (1992). "Shape properties of the g- and h- and Johnson families". Comm. Statistics — Theory and Methods. 21: 1244–1250.
Skewness Measures for the Weibull Distribution

External links

Wikiversity has learning resources about Skewness

Hazewinkel, Michiel, ed. (2001) [1994], "Asymmetry coefficient", Encyclopedia of Mathematics, Springer Science+Business Media B.V. / Kluwer Academic Publishers, ISBN 978-1-55608-010-4
An Asymmetry Coefficient for Multivariate Distributions by Michel Petitjean
On More Robust Estimation of Skewness and Kurtosis Comparison of skew estimators by Kim and White.
Closed-skew Distributions — Simulation, Inversion and Parameter Estimation

Statistics

Descriptive statistics

Continuous data

Center	Mean arithmetic geometric harmonic Median Mode
Dispersion	Variance Standard deviation Coefficient of variation Percentile Range Interquartile range
Shape	Moments Skewness Kurtosis L-moments

Count data

Index of dispersion

Summary tables

Dependence

Graphics

Data collection

Study design	Population Statistic Effect size Statistical power Sample size determination Missing data
Survey methodology	Sampling stratified cluster Standard error Opinion poll Questionnaire
Controlled experiments	Design control optimal Controlled trial Randomized Random assignment Replication Blocking Interaction Factorial experiment
Uncontrolled studies	Observational study Natural experiment Quasi-experiment

Statistical inference

Statistical theory

Frequentist inference

Point estimation	Estimating equations Maximum likelihood Method of moments M-estimator Minimum distance Unbiased estimators Mean-unbiased minimum-variance Rao–Blackwellization Lehmann–Scheffé theorem Median unbiased Plug-in
Interval estimation	Confidence interval Pivot Likelihood interval Prediction interval Tolerance interval Resampling Bootstrap Jackknife
Testing hypotheses	1- & 2-tails Power Uniformly most powerful test Permutation test Randomization test Multiple comparisons
Parametric tests	Likelihood-ratio Wald Score

Specific tests

Z (normal) Student's t-test F
Goodness of fit	Chi-squared Kolmogorov–Smirnov Anderson–Darling Lilliefors Jarque–Bera Normality (Shapiro–Wilk) Likelihood-ratio test Model selection Cross validation AIC BIC
Rank statistics	Sign Sample median Signed rank (Wilcoxon) Hodges–Lehmann estimator Rank sum (Mann–Whitney) Nonparametric anova 1-way (Kruskal–Wallis) 2-way (Friedman) Ordered alternative (Jonckheere–Terpstra)

Bayesian inference

Correlation	Pearson product-moment Partial correlation Confounding variable Coefficient of determination
Regression analysis	Errors and residuals Regression model validation Mixed effects models Simultaneous equations models Multivariate adaptive regression splines (MARS)
Linear regression	Simple linear regression Ordinary least squares General linear model Bayesian regression
Non-standard predictors	Nonlinear regression Nonparametric Semiparametric Isotonic Robust Heteroscedasticity Homoscedasticity
Generalized linear model	Exponential families Logistic (Bernoulli) / Binomial / Poisson regressions
Partition of variance	Analysis of variance (ANOVA, anova) Analysis of covariance Multivariate ANOVA Degrees of freedom

Categorical / Multivariate / Time-series / Survival analysis

Categorical

Multivariate

Time-series

General	Decomposition Trend Stationarity Seasonal adjustment Exponential smoothing Cointegration Structural break Granger causality
Specific tests	Dickey–Fuller Johansen Q-statistic (Ljung–Box) Durbin–Watson Breusch–Godfrey
Time domain	Autocorrelation (ACF) partial (PACF) Cross-correlation (XCF) ARMA model ARIMA model (Box–Jenkins) Autoregressive conditional heteroskedasticity (ARCH) Vector autoregression (VAR)
Frequency domain	Spectral density estimation Fourier analysis Wavelet

Survival

Survival function	Kaplan–Meier estimator (product limit) Proportional hazards models Accelerated failure time (AFT) model First hitting time
Hazard function	Nelson–Aalen estimator
Test	Log-rank test

Applications

Biostatistics	Bioinformatics Clinical trials / studies Epidemiology Medical statistics
Engineering statistics	Chemometrics Methods engineering Probabilistic design Process / quality control Reliability System identification
Social statistics	Actuarial science Census Crime statistics Demography Econometrics National accounts Official statistics Population statistics Psychometrics
Spatial statistics	Cartography Environmental statistics Geographic information system Geostatistics Kriging

Category
Portal
Commons
WikiProject

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.

Skewness

Introduction

Relationship of mean and median

Definition

Pearson's moment coefficient of skewness

Examples

Properties

Sample skewness

Applications

Other measures of skewness

Pearson's first skewness coefficient (mode skewness)

Pearson's second skewness coefficient (median skewness)

Quantile-based measures

Groeneveld & Meeden’s coefficient

L-moments

Distance skewness

Medcouple

See also

Notes

References

External links