IDEAS home Printed from https://ideas.repec.org/p/ags/umamwp/14518.html
   My bibliography  Save this paper

A Meta-Analysis Of Hypothetical Bias In Stated Preference Valuation

Author

Listed:
  • Murphy, James J.
  • Allen, P. Geoffrey
  • Stevens, Thomas H.
  • Weatherhead, Darryl

Abstract

Individuals are widely believed to overstate their economic valuation of a good by a factor of two or three. This paper reports the results of a meta-analysis of hypothetical bias in 28 stated preference valuation studies that report monetary willingness-to-pay and that used the same mechanism for eliciting both hypothetical and actual values. The papers generated 83 observations with a median value of the ratio of hypothetical to actual value of 1.35, and the distribution has severe positive skewness. Since a comprehensive theory of hypothetical bias has not been developed, we use a set of explanatory variables based on issues that have been investigated in previous research. We find that a choice-based elicitation mechanism is important in reducing bias, though an insufficient number of studies and confounding with other variables prevents us from characterizing individual mechanisms. We provide some evidence that the use of student subjects may be a source of bias, but this variable is highly correlated with group experimental settings and no firm conclusions can be drawn. There is some weak evidence that bias increases when public goods are being valued, and that some calibration methods are effective at reducing bias. Results are quite sensitive to model specification, which will remain a problem until a comprehensive theory of hypothetical bias is developed.

Suggested Citation

  • Murphy, James J. & Allen, P. Geoffrey & Stevens, Thomas H. & Weatherhead, Darryl, 2003. "A Meta-Analysis Of Hypothetical Bias In Stated Preference Valuation," Working Paper Series 14518, University of Massachusetts, Amherst, Department of Resource Economics.
    • Handle: RePEc:ags:umamwp:14518
    DOI: 10.22004/ag.econ.14518
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/14518/files/wp030008.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.14518?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bohm, Peter, 1972. "Estimating demand for public goods: An experiment," European Economic Review, Elsevier, vol. 3(2), pages 111-130.
    2. Thomas C. Brown & Patricia A. Champ & Richard C. Bishop & Daniel W. McCollum, 1996. "Which Response Format Reveals the Truth about Donations to a Public Good?," Land Economics, University of Wisconsin Press, vol. 72(2), pages 152-166.
    3. Edward Balistreri & Gary McClelland & Gregory Poe & William Schulze, 2001. "Can Hypothetical Questions Reveal True Values? A Laboratory Comparison of Dichotomous Choice and Open-Ended Contingent Values with Auction Values," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 18(3), pages 275-292, March.
    4. List, John A. & Shogren, Jason F., 1998. "Calibration of the difference between actual and hypothetical valuations in a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 37(2), pages 193-205, October.
    5. Jack A. Sinden, 1988. "Empirical Tests Of Hypothetical Bias In Consumers' Surplus Surveys," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 32(2-3), pages 98-112, 08-12.
    6. List, John A, 2003. "Using Random nth Price Auctions to Value Non-market Goods and Services," Journal of Regulatory Economics, Springer, vol. 23(2), pages 193-205, March.
    7. Carlsson, Fredrik & Martinsson, Peter, 2001. "Do Hypothetical and Actual Marginal Willingness to Pay Differ in Choice Experiments?: Application to the Valuation of the Environment," Journal of Environmental Economics and Management, Elsevier, vol. 41(2), pages 179-192, March.
    8. Vossler, Christian A. & Kerkvliet, Joe & Polasky, Stephen & Gainutdinova, Olesya, 2003. "Externally validating contingent valuation: an open-space survey and referendum in Corvallis, Oregon," Journal of Economic Behavior & Organization, Elsevier, vol. 51(2), pages 261-277, June.
    9. Sinden, Jack A., 1988. "Empirical Tests Of Hypothetical Bias In Consumers' Surplus Surveys," Australian Journal of Agricultural Economics, Australian Agricultural and Resource Economics Society, vol. 32(2-3), pages 1-15, August.
    10. Peter Frykblom, 2000. "Willingness to pay and the choice of question format: experimental results," Applied Economics Letters, Taylor & Francis Journals, vol. 7(10), pages 665-667.
    11. Laura O. Taylor & Ronald G. Cummings, 1999. "Unbiased Value Estimates for Environmental Goods: A Cheap Talk Design for the Contingent Valuation Method," American Economic Review, American Economic Association, vol. 89(3), pages 649-665, June.
    12. Magnus Johannesson & Bengt Liljas & Per-Olov Johansson, 1998. "An experimental comparison of dichotomous choice contingent valuation questions and real purchase decisions," Applied Economics, Taylor & Francis Journals, vol. 30(5), pages 643-647.
    13. McClelland, Gary H & Schulze, William D & Coursey, Don L, 1993. "Insurance for Low-Probability Hazards: A Bimodal Response to Unlikely Events," Journal of Risk and Uncertainty, Springer, vol. 7(1), pages 95-116, August.
    14. W. Michael Hanemann, 1984. "Welfare Evaluations in Contingent Valuation Experiments with Discrete Responses," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 66(3), pages 332-341.
    15. Vivien Foster & Ian J. Bateman & David Harley, 1998. "Real and hypothetical willingness to pay for environmental preservation: a non-experimental comparison," Chapters, in: Melinda Acutt & Pamela Mason (ed.), Environmental Valuation, Economic Policy and Sustainability, chapter 3, pages 35-50, Edward Elgar Publishing.
    16. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    17. Frykblom, Peter, 1997. "Hypothetical Question Modes and Real Willingness to Pay," Journal of Environmental Economics and Management, Elsevier, vol. 34(3), pages 275-287, November.
    18. Bishop, Richard C. & Heberlein, Thomas A., 1979. "Measuring Values Of Extramarket Goods: Are Indirect Measures Biased?," 1979 Annual Meeting, July 29-August 1, Pullman, Washington 277818, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    19. Vossler, Christian A. & Kerkvliet, Joe, 2003. "A criterion validity test of the contingent valuation method: comparing hypothetical and actual voting behavior for a public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 45(3), pages 631-649, May.
    20. Richard T. Carson & Nicholas E. Flores & Kerry M. Martin & Jennifer L. Wright, 1996. "Contingent Valuation and Revealed Preference Methodologies: Comparing the Estimates for Quasi-Public Goods," Land Economics, University of Wisconsin Press, vol. 72(1), pages 80-99.
    21. John A. Fox & Jason F. Shogren & Dermot J. Hayes & James B. Kliebenstein, 1998. "CVM-X: Calibrating Contingent Values with Experimental Auction Markets," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 80(3), pages 455-465.
    22. Peter Bohm, 1972. "Estimating the demand for public goods: An experiment," Framed Field Experiments 00126, The Field Experiments Website.
    23. Helen R. Neill & Ronald G. Cummings & Philip T. Ganderton & Glenn W. Harrison & Thomas McGuckin, 1994. "Hypothetical Surveys and Real Economic Commitments," Land Economics, University of Wisconsin Press, vol. 70(2), pages 145-154.
    24. List, John A. & Shogren, Jason F., 2002. "Calibration of Willingness-to-Accept," Journal of Environmental Economics and Management, Elsevier, vol. 43(2), pages 219-233, March.
    25. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    26. Anabela Botelho & Ligia Costa Pinto, 2002. "Hypothetical, real, and predicted real willingness to pay in open-ended surveys: experimental results," Applied Economics Letters, Taylor & Francis Journals, vol. 9(15), pages 993-996.
    27. Blumenschein, Karen & Johannesson, Magnus & Blomquist, Glenn C. & Liljas, Bengt & O'Conor, Richard M., 1997. "Hypothetical versus real payments in Vickrey auctions," Economics Letters, Elsevier, vol. 56(2), pages 177-180, October.
    28. Champ, Patricia A. & Bishop, Richard C. & Brown, Thomas C. & McCollum, Daniel W., 1997. "Using Donation Mechanisms to Value Nonuse Benefits from Public Goods," Journal of Environmental Economics and Management, Elsevier, vol. 33(2), pages 151-162, June.
    29. John Loomis & Thomas Brown & Beatrice Lucero & George Peterson, 1997. "Evaluating the Validity of the Dichotomous Choice Question Format in Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 10(2), pages 109-123, September.
    30. Boyce, Rebecca R, et al, 1992. "An Experimental Examination of Intrinsic Values as a," American Economic Review, American Economic Association, vol. 82(5), pages 1366-1373, December.
    31. Cameron, Trudy Ann & Poe, Gregory L. & Ethier, Robert G. & Schulze, William D., 2002. "Alternative Non-market Value-Elicitation Methods: Are the Underlying Preferences the Same?," Journal of Environmental Economics and Management, Elsevier, vol. 44(3), pages 391-425, November.
    32. John Loomis & Thomas Brown & Beatrice Lucero & George Peterson, 1996. "Improving Validity Experiments of Contingent Valuation Methods: Results of Efforts to Reduce the Disparity of Hypothetical and Actual Willingness to Pay," Land Economics, University of Wisconsin Press, vol. 72(4), pages 450-461.
    33. Irwin, Julie R & Slovic, Paul & Lichtenstein, Sarah & McClelland, Gary H., 1993. "Preference Reversals and the Measurement of Environmental Values," Journal of Risk and Uncertainty, Springer, vol. 6(1), pages 5-18, January.
    34. Mary Jo Kealy & John F. Dovidio & Mark L. Rockel, 1988. "Accuracy in Valuation Is a Matter of Degree," Land Economics, University of Wisconsin Press, vol. 64(2), pages 158-171.
    35. Magnus Johannesson, 1997. "Some further experimental results on hypothetical versus real willingness to pay," Applied Economics Letters, Taylor & Francis Journals, vol. 4(8), pages 535-536.
    36. Smith, V. Kerry & Mansfield, Carol, 1998. "Buying Time: Real and Hypothetical Offers," Journal of Environmental Economics and Management, Elsevier, vol. 36(3), pages 209-224, November.
    37. Blumenschein, Karen & Johannesson, Magnus & Yokoyama, Krista K. & Freeman, Patricia R., 2001. "Hypothetical versus real willingness to pay in the health care sector: results from a field experiment," Journal of Health Economics, Elsevier, vol. 20(3), pages 441-457, May.
    38. Cummings, Ronald G & Harrison, Glenn W & Rutstrom, E Elisabet, 1995. "Homegrown Values and Hypothetical Surveys: Is the Dichotomous Choice Approach Incentive-Compatible?," American Economic Review, American Economic Association, vol. 85(1), pages 260-266, March.
    39. Don L. Coursey & John L. Hovis & William D. Schulze, 1987. "The Disparity Between Willingness to Accept and Willingness to Pay Measures of Value," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 102(3), pages 679-690.
    40. Brookshire, David S & Coursey, Don L, 1987. "Measuring the Value of a Public Good: An Empirical Comparison of Elicitation Procedures," American Economic Review, American Economic Association, vol. 77(4), pages 554-566, September.
    41. Spencer, Michael A. & Swallow, Stephen K. & Miller, Christopher J., 1998. "Valuing Water Quality Monitoring: A Contingent Valuation Experiment Involving Hypothetical and Real Payments," Agricultural and Resource Economics Review, Cambridge University Press, vol. 27(1), pages 28-42, April.
    42. Thomas C. Brown, 1984. "The Concept of Value in Resource Allocation," Land Economics, University of Wisconsin Press, vol. 60(3), pages 231-246.
    43. Kealy, Mary Jo & Montgomery, Mark & Dovidio, John F., 1990. "Reliability and predictive validity of contingent values: Does the nature of the good matter?," Journal of Environmental Economics and Management, Elsevier, vol. 19(3), pages 244-263, November.
    44. John A. List, 2001. "Do Explicit Warnings Eliminate the Hypothetical Bias in Elicitation Procedures? Evidence from Field Auctions for Sportscards," American Economic Review, American Economic Association, vol. 91(5), pages 1498-1507, December.
    45. Brown, Kelly M. & Taylor, Laura O., 2000. "Do as you say, say as you do: evidence on gender differences in actual and stated contributions to public goods," Journal of Economic Behavior & Organization, Elsevier, vol. 43(1), pages 127-139, September.
    46. Richard C. Bishop & Thomas A. Heberlein, 1979. "Measuring Values of Extramarket Goods: Are Indirect Measures Biased?," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 61(5), pages 926-930.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kanya, Lucy & Sanghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: A systematic review and meta-analysis of the evidence," Social Science & Medicine, Elsevier, vol. 232(C), pages 238-261.
    2. List, John A. & Shogren, Jason F., 2002. "Calibration of Willingness-to-Accept," Journal of Environmental Economics and Management, Elsevier, vol. 43(2), pages 219-233, March.
    3. Kanya, Lucy & Saghera, Sabina & Lewin, Alex & Fox-Rushby, Julia, 2019. "The criterion validity of willingness to pay methods: a systematic review and meta-analysis of the evidence," LSE Research Online Documents on Economics 100741, London School of Economics and Political Science, LSE Library.
    4. John List & Craig Gallet, 2001. "What Experimental Protocol Influence Disparities Between Actual and Hypothetical Stated Values?," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 20(3), pages 241-254, November.
    5. John K. Horowitz & Kenneth E. McConnell & James J. Murphy, 2013. "Behavioral foundations of environmental economics and valuation," Chapters, in: John A. List & Michael K. Price (ed.), Handbook on Experimental Economics and the Environment, chapter 4, pages 115-156, Edward Elgar Publishing.
    6. Shogren, Jason F., 2006. "Experimental Methods and Valuation," Handbook of Environmental Economics, in: K. G. Mäler & J. R. Vincent (ed.), Handbook of Environmental Economics, edition 1, volume 2, chapter 19, pages 969-1027, Elsevier.
    7. Murphy, James J. & Stevens, Thomas H., 2004. "Contingent Valuation, Hypothetical Bias, and Experimental Economics," Agricultural and Resource Economics Review, Cambridge University Press, vol. 33(2), pages 182-192, October.
    8. Gubanova, Tatiana & Adamowicz, Wiktor L. & McMillan, Melville, 2009. "‘Pocket and Pot’: Hypothetical Bias in a No-Free-Riding Public Contribution Game," 2009 Annual Meeting, July 26-28, 2009, Milwaukee, Wisconsin 49318, Agricultural and Applied Economics Association.
    9. Liljas, Bengt & Blumenschein, Karen, 2000. "On hypothetical bias and calibration in cost-benefit studies," Health Policy, Elsevier, vol. 52(1), pages 53-70, May.
    10. Gregory Poe & Jeremy Clark & Daniel Rondeau & William Schulze, 2002. "Provision Point Mechanisms and Field Validity Tests of Contingent Valuation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 23(1), pages 105-131, September.
    11. Johnston, Robert J., 2006. "Is hypothetical bias universal? Validating contingent valuation responses using a binding public referendum," Journal of Environmental Economics and Management, Elsevier, vol. 52(1), pages 469-481, July.
    12. Jinkwon Lee & Uk Hwang, 2016. "Hypothetical Bias in Risk Preferences as a Driver of Hypothetical Bias in Willingness to Pay: Experimental Evidence," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 65(4), pages 789-811, December.
    13. Svensson, Mikael, 2006. "The Value of a Statistical Life in Sweden Estimates from Two Studies using the "Certainty Approach" Calibration," Working Papers 2006:6, Örebro University, School of Business, revised 12 May 2009.
    14. Richard T. Carson, 2011. "Contingent Valuation," Books, Edward Elgar Publishing, number 2489.
    15. Whitehead, John C. & Cherry, Todd L., 2007. "Willingness to pay for a Green Energy program: A comparison of ex-ante and ex-post hypothetical bias mitigation approaches," Resource and Energy Economics, Elsevier, vol. 29(4), pages 247-261, November.
    16. Ana Bedate & Luis Herrero & José Sanz, 2009. "Economic valuation of a contemporary art museum: correction of hypothetical bias using a certainty question," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 33(3), pages 185-199, August.
    17. Veisten, Knut, 2007. "Contingent valuation controversies: Philosophic debates about economic theory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 36(2), pages 204-232, April.
    18. Atozou, Baoubadi & Tamini, Lota D. & Bergeronm, Stephane & Doyon, Maurice, 2020. "Factors Explaining the Hypothetical Bias: How to Improve Models for Meta-Analyses," Journal of Agricultural and Resource Economics, Western Agricultural Economics Association, vol. 45(2), March.
    19. Jie He & Jérôme Dupras & Thomas G. Poder, 2018. "Payment and Provision Consequentiality in Voluntary Contribution Mechanism: Single or Double “Knife-Edge” Evidence?," Cahiers de recherche 18-02, Departement d'économique de l'École de gestion à l'Université de Sherbrooke.
    20. Hensher, David A., 2010. "Hypothetical bias, choice experiments and willingness to pay," Transportation Research Part B: Methodological, Elsevier, vol. 44(6), pages 735-752, July.

    More about this item

    Keywords

    Resource /Energy Economics and Policy;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:umamwp:14518. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/drumaus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.