Kaplan–Meier estimator
The Kaplan–Meier estimator,[1][2] also known as the product limit estimator, is a non-parametric statistic used to estimate the survival function from lifetime data. In medical research, it is often used to measure the fraction of patients living for a certain amount of time after treatment. In other fields, Kaplan–Meier estimators may be used to measure the length of time people remain unemployed after a job loss,[3] the time-to-failure of machine parts, or how long fleshy fruits remain on plants before they are removed by frugivores. The estimator is named after Edward L. Kaplan and Paul Meier, who each submitted similar manuscripts to the Journal of the American Statistical Association. The journal editor, John Tukey, convinced them to combine their work into one paper, which has been cited about 50,000 times since its publication.[4][5]
Basic concepts
A plot of the Kaplan–Meier estimator is a series of declining horizontal steps which, with a large enough sample size, approaches the true survival function for that population. The value of the survival function between successive distinct sampled observations ("clicks") is assumed to be constant.
An important advantage of the Kaplan–Meier curve is that the method can take into account some types of censored data, particularly right-censoring, which occurs if a patient withdraws from a study, is lost to follow-up, or is alive without event occurrence at last follow-up. On the plot, small vertical tick-marks indicate individual patients whose survival times have been right-censored. When no truncation or censoring occurs, the Kaplan–Meier curve is the complement of the empirical distribution function.
In medical statistics, a typical application might involve grouping patients into categories, for instance, those with Gene A profile and those with Gene B profile. In the graph, patients with Gene B die much more quickly than those with gene A. After two years, about 80% of the Gene A patients survive, but less than half of patients with Gene B.
In order to generate a Kaplan–Meier estimator, at least two pieces of data are required for each patient (or each subject): the status at last observation (event occurrence or right-censored) and the time to event (or time to censoring). If the survival functions between two or more groups are to be compared, then a third piece of data is required: the group assignment of each subject.[6]
Benefits and limitations
The Kaplan–Meier estimator is one of the most frequently used methods of survival analysis. The estimate may be useful to examine recovery rates, the probability of death, and the effectiveness of treatment. It is limited in its ability to estimate survival adjusted for covariates; parametric survival models and the Cox Proportional hazards model may be useful to estimate covariate-adjusted survival.
Statistical considerations
The Kaplan–Meier estimator is a statistic, and several estimators are used to approximate its variance. One of the most common estimators is Greenwood's formula:[7]
where is the number of cases and is the total number of observations, for .
In some cases, one may wish to compare different Kaplan–Meier curves. This can be done by the log rank test, and the Cox proportional hazards test.
Other statistics that may be of use with this estimator are the Hall-Wellner band[8] and the equal-precision band.[9]
Software
- SAS: The Kaplan–Meier estimator is implemented in the
proc lifetest
procedure.[10] - R: the Kaplan–Meier estimator is available as part of the
survival
package.[11][12][13] - Stata: the command
sts
returns the Kaplan–Meier estimator.[14][15] - Python: the
lifelines
package includes the Kaplan–Meier estimator.[16] - MATLAB: the
ecdf
function with the'function','survivor'
arguments can calculate or plot the Kaplan–Meier estimator.[17]
See also
References
- ↑ Kaplan, E. L.; Meier, P. (1958). "Nonparametric estimation from incomplete observations". J. Amer. Statist. Assn. 53 (282): 457–481. JSTOR 2281868. doi:10.2307/2281868.
- ↑ Kaplan, E.L. in a retrospective on the seminal paper in "This week's citation classic". Current Contents 24, 14 (1983). Available from UPenn as PDF.
- ↑ Meyer, Bruce D. (1990). "Unemployment Insurance and Unemployment Spells". Econometrica. 58 (4): 757–782. doi:10.2307/2938349.
- ↑ "- Google Scholar". scholar.google.com. Retrieved 2017-03-04.
- ↑ "Paul Meier, 1924–2011". Chicago Tribune. August 18, 2011.
- ↑ Rich JT, Neely JG, Paniello RC, Voelker CC, Nussenbaum B, Wang EW (2010). "A practical guide to understanding Kaplan–Meier curves.". Otolaryngol Head Neck Surg. 143 (3): 331–6. PMC 3932959 . PMID 20723767. doi:10.1016/j.otohns.2010.05.007.
- ↑ Greenwood, M. (1926). "The natural duration of cancer". Reports on Public Health and Medical Subjects. London: Her Majesty's Stationery Office. 33: 1–26.
- ↑ Hall WJ and Wellner JA (1980) Confidence bands for a survival curve for censored data. Biometrika 69
- ↑ Nair VN (1984) Confidence bands for survival functions with censored data: A comparative study. Technometrics 26: 265–275
- ↑ The LIFETEST Procedure
- ↑ "survival: Survival Analysis". R Project.
- ↑ Willekens, Frans (2014). "The Survival Package". Multistate Analysis of Life Histories with R. Springer. pp. 135–153. ISBN 978-3-319-08383-4. doi:10.1007/978-3-319-08383-4_6.
- ↑ Chen, Ding-Geng; Peace, Karl E. (2014). Clinical Trial Data Analysis Using R. CRC Press. pp. 99–108.
- ↑ "sts — Generate, graph, list, and test the survivor and cumulative hazard functions" (PDF). Stata Manual.
- ↑ Cleves, Mario (2008). An Introduction to Survival Analysis Using Stata (Second ed.). College Station: Stata Press. pp. 93–107. ISBN 1-59718-041-6.
- ↑ "lifelines"..
- ↑ "Empirical cumulative distribution function - MATLAB ecdf". mathworks.com. Retrieved 2016-06-16.
Further reading
- Aalen, Odd; Borgan, Ornulf; Gjessing, Hakon (2008). Survival and Event History Analysis: A Process Point of View. Springer. pp. 90–104. ISBN 978-0-387-68560-1.
- Greene, William H. (2012). "Nonparametric and Semiparametric Approaches". Econometric Analysis (Seventh ed.). Prentice-Hall. pp. 909–912. ISBN 978-0-273-75356-8.
- Jones, Andrew M.; Rice, Nigel; D'Uva, Teresa Bago; Balia, Silvia (2013). "Duration Data". Applied Health Economics. London: Routledge. pp. 139–181. ISBN 978-0-415-67682-3.
- Singer, Judith B.; Willett, John B. (2003). Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence. New York: Oxford University Press. pp. 483–487. ISBN 0-19-515296-4.
External links
- Dunn, Steve (2002). "Survival Curves: Accrual and The Kaplan-Meier Estimate". Cancer Guide. Statistics.
- Staub, Linda; Gekenidis, Alexandros (Mar 7, 2011). "Kaplan–Meier Survival Curves and the Log-Rank Test" (PDF). Survival Analysis (pdf). Handout and presentation. Seminar for Statistics (SfS). Eidgenössische Technische Hochschule Zürich (ETH) [Swiss Federal Institute of Technology Zurich].
- Three evolving Kaplan-Meier curves on YouTube