Mean absolute scaled error

In statistics, the mean absolute scaled error (MASE) is a measure of the accuracy of forecasts . It was proposed in 2006 by Australian statistician Rob J. Hyndman, who described it as a "generally applicable measurement of forecast accuracy without the problems seen in the other measurements."[1]

The mean absolute scaled error is given by

\mathrm{MASE} = \frac{1}{n}\sum_{t=1}^n\left( \frac{\left| e_t \right|}{\frac{1}{n-1}\sum_{i=2}^n \left| Y_i-Y_{i-1}\right|} \right) = \frac{\sum_{t=1}^{n} \left| e_t \right|}{\frac{n}{n-1}\sum_{i=2}^n \left| Y_i-Y_{i-1}\right|}[2]

where the numerator et is the forecast error for a given period, defined as the actual value (Yt) minus the forecast value (Ft) for that period: et = Yt − Ft, and the denominator is the average forecast error of the one-step "naive forecast method", which uses the actual value from the prior period as the forecast: Ft = Yt−1[3]

This scale-free error metric "can be used to compare forecast methods on a single series and also to compare forecast accuracy between series. This metric is well suited to intermittent-demand series because it never gives infinite or undefined values[1] except in the irrelevant case where all historical data are equal.[2]

See also

References

  1. ↑ 1.0 1.1 Hyndman, R. J. (2006). "Another look at measures of forecast accuracy", FORESIGHT Issue 4 June 2006, pg46
  2. ↑ 2.0 2.1 Hyndman, R. J. and Koehler A. B. (2006). "Another look at measures of forecast accuracy." International Journal of Forecasting volume 22 issue 4, pages 679-688. doi:10.1016/j.ijforecast.2006.03.001
  3. ↑ Hyndman, Rob et al, Forecasting with Exponential Smoothing: The State Space Approach, Berlin: Springer-Verlag, 2008. ISBN 978-3-540-71916-8.