Consensus forecast

"Consensus forecasts" redirects here. For Consensus ForecastsTM published by Consensus Economics, see Consensus Economics.

Used in a number of sciences, ranging from econometrics to meteorology, consensus forecasts are predictions of the future that are created by combining together several separate forecasts which have often been created using different methodologies. Also known as combining forecasts, forecast averaging or model averaging (in econometrics and statistics) and committee machines, ensemble averaging or expert aggregation (in machine learning). Applications can range from forecasting the weather to predicting the annual Gross Domestic Product of a country or the number of cars a company or an individual dealer is likely to sell in a year. While forecasts are often made for future values of a time series, they can also be for one-off events such as the outcome of a presidential election or a football match.

Background

Forecasting plays a key role in any organisation's planning process as it provides insight into uncertainty. Through simulation, one will be able to assess whether proposed strategies are likely to produce the desired objectives within predefined limits. In the field of economic forecasting, the future path of the economy is intrinsic to almost every company's business success, and hence there is considerable demand for accurate economic forecasts. Matching this strong demand is the large volume of readily available forecast information from private firms, government and various international agencies. However, deciphering the best forecast method is no easy task, and largely depends on the objectives of the user and the constraints they are likely to face. Rather than try to identify a single best forecasting method, an alternative approach is to combine the results from independent forecasters and take an average of the forecasts.

This method of taking a simple mean average of a panel of independent forecasts, derived from different forecasting methods, is known as combining forecasts and the result is often referred to as a consensus forecast. Unless a particular forecast model which produces smaller forecast errors compared to other individual forecasts can be identified, adopting the consensus approach can be beneficial due to diversification gains. Combining economic forecasts is well established in many countries and can count central banks, government institutions and businesses among the users. In recent decades, consensus forecasts have attracted much interest, backed by the publication of a huge swathe of academic research on forecast accuracy. Empirical studies show that pooling forecasts increased forecast accuracy.[1][2][3] One of the advantages of using consensus forecasts is that it can prove useful if there is a high degree of uncertainty or risk attached to the situation and the selection of the most accurate forecast in advance is difficult. Even if one method is identified as the best, combining is still worthwhile if other methods can make some positive contribution to the forecast accuracy. Moreover, many factors can affect the independent forecast and these, along with any additional useful information, might be captured by using the consensus approach. Another argument in favour of this method is that individual forecasts may be subject to numerous behavioural biases, but these can be minimised by combining independent forecasts together. Hence, combining is seen as helping to improve forecast accuracy by reducing the forecast errors of individual forecasts. Furthermore, averaging forecasts is likely to be more useful when the data and the forecasting techniques that the component forecasts are drawn from differ substantially. And even though it is only a simple approach (typically an unweighted mean average), this method is just as useful as other more sophisticated models. Indeed, more recent studies in the past decade have shown that, over time, the equal weights combined forecast is usually more accurate than the individual forecast which make up the consensus.[4][5][6]

In sum, the usefulness of the consensus forecast technique has been supported by a wealth of empirical studies in recent decades. The use of equal weights in the combining method is appealing because of its simplicity and is easy to describe. Among others, this simple method of averaging the forecasts of individual forecasters has been put into practice by many of the world's central banks as they try to gauge expectations in the private sector. An empirical study carried out by Roy Batchelor in 2000 demonstrates greater accuracy in the consensus forecasts over macroeconomic projections produced by leading multinational agencies such as the International Monetary Fund and the Organisation for Economic Co-operation and Development.[7] A study by Robert C. Jones found: "At least since the publication of “The Combination of Forecasts” (Bates and Granger [1969]), economists have known that combining forecasts from different sources can both improve accuracy and reduce forecaster error. In the intervening years, numerous studies have confirmed these conclusions, outlined conditions under which forecast combinations are most effective, and tried to explain why simple equal weights work so well relative to more sophisticated statistical techniques.” [8]

Probabilistic forecasts

Although the literature on the combination of point forecasts is very rich, the topic of combining probabilistic forecasts is not so popular.[3] There are very few papers that deal explicitly with the combination of interval forecasts, however, there has been some progress in the area of density forecasts.[9][10] A simple, yet powerful alternative technique has been introduced in the context of electricity price forecasting. Quantile Regression Averaging (QRA) involves applying quantile regression to the point forecasts of a number of individual forecasting models or experts.[11] It has been found to perform extremely well in practice - the top two performing teams in the price track of the Global Energy Forecasting Competition (GEFCom2014) used variants of QRA.

See also

Further reading

References

  1. ↑ Clemen, Robert T. (1989). "Combining forecasts: A review and annotated bibliography". International Journal of Forecasting 5 (4): 559–583. doi:10.1016/0169-2070(89)90012-5.
  2. ↑ Blix, Marten; Wadefjord, Joachim; Wienecke, Ulrika; Adahl, Martin (2001). "How good is the forecasting performance of major institutions?". Economic Review. 3/2001.
  3. 1 2 Timmermann, Allan (2006). G. Elliott, C. W. J. Granger and A. Timmermann, ed. Chapter 4 Forecast Combinations 1. Elsevier. pp. 135–196. doi:10.1016/s1574-0706(05)01004-9.
  4. ↑ Makridakis; Hibon (2000). "The M3-Competition: Results, Conclusions and Implications". International Journal of Forecasting 16: 451–476. doi:10.1016/s0169-2070(00)00057-1.
  5. ↑ McNees, Stephen K. (November 1987). "Consensus Forecasts: Tyranny of the Majority". New England Economic Review.
  6. ↑ Golinelli, R.; Parigi, G. (2008). "Real-Time Squared: A Real-Time Data Set for Real-Time GDP Forecasting". International Journal of Forecasting 24 (3): 368–385. doi:10.1016/j.ijforecast.2008.05.001.
  7. ↑ Batchelor, Roy (2000). "The IMF and OECD versus Consensus Forecasts". Applied Economics 33 (2): 225–235. doi:10.1080/00036840121785.
  8. ↑ Jones, Robert C. (2014). "Making Better Investment Decisions". The Journal of Portfolio Management 40 (2): 128–143. doi:10.3905/jpm.2014.40.2.128.
  9. ↑ Wallis, Kenneth F. (2005). "Combining Density and Interval Forecasts: A Modest Proposal*". Oxford Bulletin of Economics and Statistics 67: 983–994. doi:10.1111/j.1468-0084.2005.00148.x. ISSN 1468-0084.
  10. ↑ Mitchell, James; Wallis, Kenneth F. (2011). "Evaluating density forecasts: forecast combinations, model mixtures, calibration and sharpness". Journal of Applied Econometrics 26 (6): 1023–1040. doi:10.1002/jae.1192. ISSN 1099-1255.
  11. ↑ Nowotarski, Jakub; Weron, Rafał (2015). [Open Access]. "Computing electricity spot price prediction intervals using quantile regression and forecast averaging". Computational Statistics 30 (3): 791–803. doi:10.1007/s00180-014-0523-0. ISSN 0943-4062.
This article is issued from Wikipedia - version of the Tuesday, December 08, 2015. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.