IDEAS home Printed from https://ideas.repec.org/p/bno/worpap/2009_23.html
   My bibliography  Save this paper

Combining VAR and DSGE forecast densities

Author

Listed:
  • Ida Wolden Bache

    (Norges Bank)

  • Anne Sofie Jore

    (Norges Bank)

  • James Mitchell

    (NIESR)

  • Shaun P. Vahey

    (Melbourne Business School)

Abstract

A popular macroeconomic forecasting strategy takes combinations across many models to hedge against instabilities of unknown timing; see (among others) Stock and Watson (2004), Clark and McCracken (2010), and Jore et al. (2010). Existing studies of this forecasting strategy exclude Dynamic Stochastic General Equilibrium (DSGE) models, despite the widespread use of these models by monetary policymakers. In this paper, we combine inflation forecast densities utilizing an ensemble system comprising many Vector Autoregressions (VARs), and a policymaking DSGE model. The DSGE receives substantial weight (for short horizons) provided the VAR components exclude structural breaks. In this case, the inflation forecast densities exhibit calibration failure. Allowing for structural breaks in the VARs reduces the weight on the DSGE considerably, and produces well-calibrated forecast densities for inflation.

Suggested Citation

  • Ida Wolden Bache & Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2009. "Combining VAR and DSGE forecast densities," Working Paper 2009/23, Norges Bank.
    • Handle: RePEc:bno:worpap:2009_23
    as

    Download full text from publisher

    File URL: https://www.norges-bank.no/en/news-events/news-publications/Papers/Working-Papers/2009/WP-200923/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Todd E. Clark & Michael W. McCracken, 2010. "Averaging forecasts from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 5-29, January.
    2. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    3. Schorfheide, Frank & Sill, Keith & Kryshko, Maxym, 2010. "DSGE model-based forecasting of non-modelled variables," International Journal of Forecasting, Elsevier, vol. 26(2), pages 348-373, April.
    4. Dr. James Mitchell, 2009. "Measuring Output Gap Uncertainty," National Institute of Economic and Social Research (NIESR) Discussion Papers 342, National Institute of Economic and Social Research.
    5. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    6. Alejandro Justiniano & Giorgio E. Primiceri, 2008. "The Time-Varying Volatility of Macroeconomic Fluctuations," American Economic Review, American Economic Association, vol. 98(3), pages 604-641, June.
    7. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    8. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    9. Anthony Garratt & Gary Koop & ShaunP. Vahey, 2008. "Forecasting Substantial Data Revisions in the Presence of Model Uncertainty," Economic Journal, Royal Economic Society, vol. 118(530), pages 1128-1144, July.
    10. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    11. Robert L. Winkler, 1981. "Combining Probability Distributions from Dependent Information Sources," Management Science, INFORMS, vol. 27(4), pages 479-488, April.
    12. Juillard, Michel, 1996. "Dynare : a program for the resolution and simulation of dynamic models with forward variables through the use of a relaxation algorithm," CEPREMAP Working Papers (Couverture Orange) 9602, CEPREMAP.
    13. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    14. Todd E. Clark, 2009. "Real-time density forecasts from VARs with stochastic volatility," Research Working Paper RWP 09-08, Federal Reserve Bank of Kansas City.
    15. Granger Clive W.J., 2008. "Non-Linear Models: Where Do We Go Next - Time Varying Parameter Models?," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 12(3), pages 1-11, September.
    16. Jana Eklund & Sune Karlsson, 2007. "Forecast Combination and Model Averaging Using Predictive Measures," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 329-363.
    17. Garratt, Anthony & Mitchell, James & Vahey, Shaun P., 2014. "Measuring output gap nowcast uncertainty," International Journal of Forecasting, Elsevier, vol. 30(2), pages 268-279.
    18. Michael P. Clements, 2004. "Evaluating the Bank of England Density Forecasts of Inflation," Economic Journal, Royal Economic Society, vol. 114(498), pages 844-866, October.
    19. Dr. James Mitchell, 2009. "Macro Modelling with Many Models," National Institute of Economic and Social Research (NIESR) Discussion Papers 337, National Institute of Economic and Social Research.
    20. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    21. Peter A. Morris, 1977. "Combining Expert Judgments: A Bayesian Approach," Management Science, INFORMS, vol. 23(7), pages 679-693, March.
    22. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    23. Cogley, Timothy, 2002. "A Simple Adaptive Measure of Core Inflation," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 34(1), pages 94-113, February.
    24. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    25. Christian Kascha & Francesco Ravazzolo, 2010. "Combining inflation density forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 231-250.
    26. Garratt, Anthony & Koop, Gary & Mise, Emi & Vahey, Shaun P., 2009. "Real-Time Prediction With U.K. Monetary Aggregates in the Presence of Model Uncertainty," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 480-491.
    27. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    28. Kenneth F. Wallis, 2005. "Combining Density and Interval Forecasts: A Modest Proposal," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 983-994, December.
    29. John Geweke, 2010. "Complete and Incomplete Econometric Models," Economics Books, Princeton University Press, edition 1, number 9218.
    30. Peter A. Morris, 1974. "Decision Analysis Expert Use," Management Science, INFORMS, vol. 20(9), pages 1233-1241, May.
    31. Valentina Corradi & Norman Swanson, 2006. "Predictive Density Evaluation. Revised," Departmental Working Papers 200621, Rutgers University, Department of Economics.
    32. Dr. James Mitchell, 2005. "Evaluating, comparing and combining density forecasts using the KLIC with an application to the Bank of England and NIESR ÔfanÕ charts of inflation," National Institute of Economic and Social Research (NIESR) Discussion Papers 253, National Institute of Economic and Social Research.
    33. Cobham,David & Eitrheim,Øyvind & Gerlach,Stefan & Qvigstad,Jan F. (ed.), 2010. "Twenty Years of Inflation Targeting," Cambridge Books, Cambridge University Press, number 9780521768184, September.
    34. Adolfson, Malin & Laséen, Stefan & Lindé, Jesper & Villani, Mattias, 2008. "Evaluating an estimated new Keynesian small open economy model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2690-2721, August.
    35. James Mitchell & Stephen G. Hall, 2005. "Evaluating, Comparing and Combining Density Forecasts Using the KLIC with an Application to the Bank of England and NIESR ‘Fan’ Charts of Inflation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(s1), pages 995-1033, December.
    36. Ida Wolden Bache & Leif Brubakk & Junior Maih, 2010. "Simple rules versus optimal policy: what fits?," Working Paper 2010/03, Norges Bank.
    37. Corradi, Valentina & Swanson, Norman R., 2006. "Predictive Density Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 5, pages 197-284, Elsevier.
    38. Mark W. Watson & James H. Stock, 2004. "Combination forecasts of output growth in a seven-country data set," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(6), pages 405-430.
    39. Dr. James Mitchell, 2009. "Measuring Output Gap Uncertainty," National Institute of Economic and Social Research (NIESR) Discussion Papers 342, National Institute of Economic and Social Research.
    40. Dennis Lindley, 1983. "Reconciliation of Probability Distributions," Operations Research, INFORMS, vol. 31(5), pages 866-880, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. DSGE models and forecasting
      by Christian Zimmermann in NEP-DGE blog on 2009-12-21 06:35:25

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    2. Rossi, Barbara & Sekhposyan, Tatevik, 2019. "Alternative tests for correct specification of conditional predictive densities," Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
    3. Gian Luigi Mazzi & James Mitchell & Gaetana Montana, 2014. "Density Nowcasts and Model Combination: Nowcasting Euro-Area GDP Growth over the 2008–09 Recession," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(2), pages 233-256, April.
    4. Knotek, Edward S. & Zaman, Saeed, 2023. "Real-time density nowcasts of US inflation: A model combination approach," International Journal of Forecasting, Elsevier, vol. 39(4), pages 1736-1760.
    5. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    6. Diebold, Francis X. & Schorfheide, Frank & Shin, Minchul, 2017. "Real-time forecast evaluation of DSGE models with stochastic volatility," Journal of Econometrics, Elsevier, vol. 201(2), pages 322-332.
    7. Ida Wolden Bache & James Mitchell & Francesco Ravazzolo & Shaun P. Vahey, 2009. "Macro modelling with many models," Working Paper 2009/15, Norges Bank.
    8. Tommaso Proietti & Martyna Marczak & Gianluigi Mazzi, 2017. "Euromind‐ D : A Density Estimate of Monthly Gross Domestic Product for the Euro Area," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 683-703, April.
    9. Raffaella Giacomini & Barbara Rossi, 2015. "Forecasting in Nonstationary Environments: What Works and What Doesn't in Reduced-Form and Structural Models," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 207-229, August.
    10. Pauwels, Laurent L. & Vasnev, Andrey L., 2016. "A note on the estimation of optimal weights for density forecast combinations," International Journal of Forecasting, Elsevier, vol. 32(2), pages 391-397.
    11. Knut Are Aastveit & James Mitchell & Francesco Ravazzolo & Herman van Dijk, 2018. "The Evolution of Forecast Density Combinations in Economics," Tinbergen Institute Discussion Papers 18-069/III, Tinbergen Institute.
    12. Rodríguez, Gabriel, 2017. "Modeling Latin-American stock and Forex markets volatility: Empirical application of a model with random level shifts and genuine long memory," The North American Journal of Economics and Finance, Elsevier, vol. 42(C), pages 393-420.
    13. Malte Knüppel, 2015. "Evaluating the Calibration of Multi-Step-Ahead Density Forecasts Using Raw Moments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(2), pages 270-281, April.
    14. Sebastiano Manzan, 2015. "Forecasting the Distribution of Economic Variables in a Data-Rich Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 144-164, January.
    15. Nalban, Valeriu, 2018. "Forecasting with DSGE models: What frictions are important?," Economic Modelling, Elsevier, vol. 68(C), pages 190-204.
    16. Periklis Gogas & Theophilos Papadimitriou & Elvira Takli, 2013. "Comparison of simple sum and Divisia monetary aggregates in GDP forecasting: a support vector machines approach," Economics Bulletin, AccessEcon, vol. 33(2), pages 1101-1115.
    17. Knut Are Aastveit & Karsten R. Gerdrup & Anne Sofie Jore & Leif Anders Thorsrud, 2014. "Nowcasting GDP in Real Time: A Density Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 48-68, January.
    18. Hoornweg, V., 2013. "Some Tools for Robustifying Econometric Analyses," Econometric Institute Research Papers 50163, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    19. Liu, Li & Wang, Yudong & Yang, Li, 2018. "Predictability of crude oil prices: An investor perspective," Energy Economics, Elsevier, vol. 75(C), pages 193-205.
    20. Rossi, Barbara & Gürkaynak, Refet & Kısacıkoğlu, Burçin, 2013. "Do DSGE Models Forecast More Accurately Out-of-Sample than VAR Models?," CEPR Discussion Papers 9576, C.E.P.R. Discussion Papers.
    21. Karsten R. Gerdrup & Anne Sofie Jore & Christie Smith & Leif Anders Thorsrud, 2009. "Evaluating ensemble density combination - forecasting GDP and inflation," Working Paper 2009/19, Norges Bank.
    22. Fresoli, Diego & Ruiz, Esther & Pascual, Lorenzo, 2015. "Bootstrap multi-step forecasts of non-Gaussian VAR models," International Journal of Forecasting, Elsevier, vol. 31(3), pages 834-848.
    23. Valeriu Nalban, 2015. "Do Bayesian Vector Autoregressive models improve density forecasting accuracy? The case of the Czech Republic and Romania," International Journal of Economic Sciences, International Institute of Social and Economic Sciences, vol. 4(1), pages 60-74, March.
    24. Jakub Ryšánek, 2010. "Combining VAR Forecast Densities Using Fast Fourier Transform," Acta Oeconomica Pragensia, Prague University of Economics and Business, vol. 2010(5), pages 72-88.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anne Sofie Jore & James Mitchell & Shaun P. Vahey, 2010. "Combining forecast densities from VARs with uncertain instabilities," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 621-634.
    2. Garratt, Anthony & Mitchell, James & Vahey, Shaun P., 2014. "Measuring output gap nowcast uncertainty," International Journal of Forecasting, Elsevier, vol. 30(2), pages 268-279.
    3. Dr. James Mitchell, 2009. "Measuring Output Gap Uncertainty," National Institute of Economic and Social Research (NIESR) Discussion Papers 342, National Institute of Economic and Social Research.
    4. Garratt, Anthony & Mitchell, James & Vahey, Shaun P. & Wakerly, Elizabeth C., 2011. "Real-time inflation forecast densities from ensemble Phillips curves," The North American Journal of Economics and Finance, Elsevier, vol. 22(1), pages 77-87, January.
    5. Ravazzolo Francesco & Vahey Shaun P., 2014. "Forecast densities for economic aggregates from disaggregate ensembles," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 18(4), pages 367-381, September.
    6. Knut Are Aastveit & Karsten R. Gerdrup & Anne Sofie Jore & Leif Anders Thorsrud, 2014. "Nowcasting GDP in Real Time: A Density Combination Approach," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(1), pages 48-68, January.
    7. Knut Are Aastveit & James Mitchell & Francesco Ravazzolo & Herman van Dijk, 2018. "The Evolution of Forecast Density Combinations in Economics," Tinbergen Institute Discussion Papers 18-069/III, Tinbergen Institute.
    8. Ida Wolden Bache & James Mitchell & Francesco Ravazzolo & Shaun P. Vahey, 2009. "Macro modelling with many models," Working Paper 2009/15, Norges Bank.
    9. Christian Kascha & Francesco Ravazzolo, 2010. "Combining inflation density forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(1-2), pages 231-250.
    10. Gian Luigi Mazzi & James Mitchell & Gaetana Montana, 2014. "Density Nowcasts and Model Combination: Nowcasting Euro-Area GDP Growth over the 2008–09 Recession," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(2), pages 233-256, April.
    11. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    12. Knut Are Aastveit & Francesco Ravazzolo & Herman K. van Dijk, 2018. "Combined Density Nowcasting in an Uncertain Economic Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(1), pages 131-145, January.
    13. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    14. Francesco Ravazzolo & Shaun P Vahey, 2010. "Measuring Core Inflation in Australia with Disaggregate Ensembles," RBA Annual Conference Volume (Discontinued), in: Renée Fry & Callum Jones & Christopher Kent (ed.),Inflation in an Era of Relative Price Shocks, Reserve Bank of Australia.
    15. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
    16. Paulo M. Sánchez & Luis Fernando Melo, 2013. "Combinación de brechas del producto colombiano," Revista ESPE - Ensayos Sobre Política Económica, Banco de la República, vol. 31(72), pages 74-82, December.
    17. Tommaso Proietti & Martyna Marczak & Gianluigi Mazzi, 2017. "Euromind‐ D : A Density Estimate of Monthly Gross Domestic Product for the Euro Area," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 683-703, April.
    18. Fabio Busetti, 2017. "Quantile Aggregation of Density Forecasts," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 79(4), pages 495-512, August.
    19. Buncic, Daniel & Müller, Oliver, 2017. "Measuring the output gap in Switzerland with linear opinion pools," Economic Modelling, Elsevier, vol. 64(C), pages 153-171.
    20. Diks, Cees & Panchenko, Valentyn & van Dijk, Dick, 2011. "Likelihood-based scoring rules for comparing density forecasts in tails," Journal of Econometrics, Elsevier, vol. 163(2), pages 215-230, August.

    More about this item

    Keywords

    Ensemble modeling; Forecast densities; Forecast evaluation; VAR models; DSGE models;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bno:worpap:2009_23. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nbgovno.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.