IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/11978.html
   My bibliography  Save this paper

Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters

Author

Listed:
  • Joseph Engelberg
  • Charles F. Manski
  • Jared Williams

Abstract

We use data from the Survey of Professional Forecasters to compare point forecasts of GDP growth and inflation with the subjective probability distributions held by forecasters. We find that SPF forecasters summarize their underlying distributions in different ways and that their summaries tend to be favorable relative to the central tendency of the underlying distributions. We also find that those forecasters who report favorable point estimates in the current survey tend to do so in subsequent surveys. These findings, plus the inescapable fact that point forecasts reveal nothing about the uncertainty that forecasters feel, suggest that the SPF and similar surveys should not ask for point forecasts. It seems more reasonable to elicit probabilistic expectations and derive measures of central tendency and uncertainty, as we do here.

Suggested Citation

  • Joseph Engelberg & Charles F. Manski & Jared Williams, 2006. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," NBER Working Papers 11978, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:11978
    Note: EFG
    as

    Download full text from publisher

    File URL: https://www.nber.org/papers/w11978.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Robert Rich & Joseph Tracy, 2004. "Uncertainty and Labor Contract Durations," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 270-287, February.
    2. Lahiri, Kajal & Teigland, Christie & Zaporowski, Mark, 1988. "Interest Rates and the Subjective Probability Distribution of Inflation Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 20(2), pages 233-248, May.
    3. N. Gregory Mankiw & Ricardo Reis & Justin Wolfers, 2004. "Disagreement about Inflation Expectations," NBER Chapters, in: NBER Macroeconomics Annual 2003, Volume 18, pages 209-270, National Bureau of Economic Research, Inc.
    4. Giordani, Paolo & Söderlind, Paul, 2002. "Is there Evidence of Pessimism and Doubt in Subjective Distributions? A Comment on Abel," SSE/EFI Working Paper Series in Economics and Finance 519, Stockholm School of Economics, revised 01 Oct 2003.
    5. Rich, R W & Raymond, J E & Butler, J S, 1992. "The Relationship between Forecast Dispersion and Forecast Uncertainty: Evidence from a Survey Data-ARCH Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(2), pages 131-148, April-Jun.
    6. Bomberger, William A, 1996. "Disagreement as a Measure of Uncertainty," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 28(3), pages 381-392, August.
    7. Victor Zarnowitz & Louis A. Lambros, 1983. "Consensus and Uncertainty in Economic Prediction," NBER Working Papers 1171, National Bureau of Economic Research, Inc.
    8. F. Thomas Juster, 1966. "Consumer Buying Intentions and Purchase Probability: An Experiment in Survey Design," NBER Books, National Bureau of Economic Research, Inc, number just66-2.
    9. Makin, John H, 1982. "Anticipated Money, Inflation Uncertainty and Real Economic Activity," The Review of Economics and Statistics, MIT Press, vol. 64(1), pages 126-134, February.
    10. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    11. Cukierman, Alex & Wachtel, Paul, 1979. "Differential Inflationary Expectations and the Variability of the Rate of Inflation: Theory and Evidence," American Economic Review, American Economic Association, vol. 69(4), pages 595-609, September.
    12. Joon-Ho Hahm & Douglas G. Steigerwald, 1999. "Consumption Adjustment under Time-Varying Income Uncertainty," The Review of Economics and Statistics, MIT Press, vol. 81(1), pages 32-40, February.
    13. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    14. Butler, Kc & Lang, Lhp, 1991. "The Forecast Accuracy Of Individual Analysts - Evidence Of Systematic Optimism And Pessimism," Journal of Accounting Research, Wiley Blackwell, vol. 29(1), pages 150-156.
    15. William F. Bassett & Robin L. Lumsdaine, 2001. "Probability Limits: Are Subjective Assessments Adequately Accurate?," Journal of Human Resources, University of Wisconsin Press, vol. 36(2), pages 327-363.
    16. Levi, Maurice D & Makin, John H, 1979. "Fisher, Phillips, Friedman and the Measured Impact of Inflation on Interest," Journal of Finance, American Finance Association, vol. 34(1), pages 35-52, March.
    17. Levi, Maurice D & Makin, John H, 1980. "Inflation Uncertainty and the Phillips Curve: Some Empirical Evidence," American Economic Review, American Economic Association, vol. 70(5), pages 1022-1027, December.
    18. Manski, C.F., 1989. "The Use Of Intentions Data To Predict Behaviour : A Best- Case Analysis," Working papers 8905, Wisconsin Madison - Social Systems.
    19. Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Post, Thomas & Hanewald, Katja, 2013. "Longevity risk, subjective survival expectations, and individual saving behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 200-220.
    2. repec:hum:wpaper:sfb649dp2010-040 is not listed on IDEAS
    3. Charles F. Manski, 2018. "Survey Measurement of Probabilistic Macroeconomic Expectations: Progress and Promise," NBER Macroeconomics Annual, University of Chicago Press, vol. 32(1), pages 411-471.
    4. Post, Thomas & Hanewald, Katja, 2010. "Stochastic mortality, subjective survival expectations, and individual saving behavior," SFB 649 Discussion Papers 2010-040, Humboldt University Berlin, Collaborative Research Center 649: Economic Risk.
    5. Kajal Lahiri & Fushang Liu, 2006. "ARCH Models for Multi-period Forecast Uncertainty: A Reality Check Using a Panel of Density Forecasts," Advances in Econometrics, in: Econometric Analysis of Financial and Economic Time Series, pages 321-363, Emerald Group Publishing Limited.
    6. Kajal Lahiri & Fushang Liu, 2006. "Modelling multi‐period inflation uncertainty using a panel of density forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(8), pages 1199-1219, December.
    7. Jean Sepulveda-Umanzor, 2004. "The Relation Between Macroeconomic Uncertainty And The Expected Performance Of the Economy," Econometric Society 2004 Latin American Meetings 304, Econometric Society.
    8. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    9. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    10. Glas, Alexander & Hartmann, Matthias, 2016. "Inflation uncertainty, disagreement and monetary policy: Evidence from the ECB Survey of Professional Forecasters," Journal of Empirical Finance, Elsevier, vol. 39(PB), pages 215-228.
    11. Jonas Dovern & Ulrich Fritsche, 2008. "Estimating fundamental cross-section dispersion from fixed event forecasts," Macroeconomics and Finance Series 200801, University of Hamburg, Department of Socioeconomics.
    12. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    13. Gianna Boero & Jeremy Smith & KennethF. Wallis, 2008. "Uncertainty and Disagreement in Economic Prediction: The Bank of England Survey of External Forecasters," Economic Journal, Royal Economic Society, vol. 118(530), pages 1107-1127, July.
    14. N. Gregory Mankiw & Ricardo Reis & Justin Wolfers, 2004. "Disagreement about Inflation Expectations," NBER Chapters, in: NBER Macroeconomics Annual 2003, Volume 18, pages 209-270, National Bureau of Economic Research, Inc.
    15. Andreas Dibiasi & David Iselin, 2021. "Measuring Knightian uncertainty," Empirical Economics, Springer, vol. 61(4), pages 2113-2141, October.
    16. Hartmann, Matthias & Herwartz, Helmut & Ulm, Maren, 2017. "A comparative assessment of alternative ex ante measures of inflation uncertainty," International Journal of Forecasting, Elsevier, vol. 33(1), pages 76-89.
    17. Christian Grimme & Steffen Henzel & Elisabeth Wieland, 2014. "Inflation uncertainty revisited: a proposal for robust measurement," Empirical Economics, Springer, vol. 47(4), pages 1497-1523, December.
    18. Jonathan H. Wright, 2011. "Term Premia and Inflation Uncertainty: Empirical Evidence from an International Panel Dataset," American Economic Review, American Economic Association, vol. 101(4), pages 1514-1534, June.
    19. Clements, Michael P., 2008. "Consensus and uncertainty: Using forecast probabilities of output declines," International Journal of Forecasting, Elsevier, vol. 24(1), pages 76-86.
    20. Hall, Stephen G. & Mitchell, James, 2007. "Combining density forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 1-13.
    21. Joshua Abel & Robert Rich & Joseph Song & Joseph Tracy, 2016. "The Measurement and Behavior of Uncertainty: Evidence from the ECB Survey of Professional Forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(3), pages 533-550, April.

    More about this item

    JEL classification:

    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods
    • E27 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
    • E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:11978. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.