IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/9128.html
   My bibliography  Save this paper

Recall Length and Measurement Error in Agricultural Surveys

Author

Listed:
  • Wollburg,Philip Randolph
  • Tiberti,Marco
  • Zezza,Alberto

Abstract

This paper assesses the relationship between the length of recall and nonrandom error in agricultural survey data. Using data from the World Bank's Living Standards Measurement Study?Integrated Surveys on Agriculture in Malawi and Tanzania, the paper shows that key input and output variables are systematically related to the length of the recall period, indicating the presence of nonrandom measurement error. With longer recall periods, farmers report greater quantities of harvest, labor, and fertilizer inputs. Farmers list fewer plots as the recall period increases. The paper argues that it is plausible that farmers overestimate plot-level outcomes, or they forget some of their more marginal plots due to longer recall periods. The analysis also finds evidence of measurement error related to the length of recall in common measures of agricultural productivity. The size of the recall effect typically varies between 2 and 5 percent per additional month of recall length, which is economically significant. With data reliability affecting policy effectiveness, improving agricultural survey data quality remains an important concern. Mainstreaming objective measures where possible and reducing the risk of recall error through shorter recall periods appear to be promising avenues to improve the quality of key variables in agricultural surveys.

Suggested Citation

  • Wollburg,Philip Randolph & Tiberti,Marco & Zezza,Alberto, 2020. "Recall Length and Measurement Error in Agricultural Surveys," Policy Research Working Paper Series 9128, The World Bank.
    • Handle: RePEc:wbk:wbrwps:9128
    as

    Download full text from publisher

    File URL: https://documents.worldbank.org/curated/en/480391580307558702/pdf/Recall-Length-and-Measurement-Error-in-Agricultural-Surveys.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Isis Gaddis & Gbemisola Oseni & Amparo Palacios-Lopez & Janneke Pieters, 2021. "Measuring Farm Labor: Survey Experimental Evidence from Ghana," The World Bank Economic Review, World Bank, vol. 35(3), pages 604-634.
    2. Calogero Carletto & Dean Jolliffe & Raka Banerjee, 2015. "From Tragedy to Renaissance: Improving Agricultural Data for Better Policies," Journal of Development Studies, Taylor & Francis Journals, vol. 51(2), pages 133-148, February.
    3. Kilic, Talip & Zezza, Alberto & Carletto, Calogero & Savastano, Sara, 2017. "Missing(ness) in Action: Selectivity Bias in GPS-Based Land Area Measurements," World Development, Elsevier, vol. 92(C), pages 143-157.
    4. Troubat, Nathalie & Grünberger, Klaus, 2017. "Impact of survey design in the estimation of habitual food consumption," Food Policy, Elsevier, vol. 72(C), pages 132-145.
    5. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    6. Carletto, Calogero & Savastano, Sara & Zezza, Alberto, 2013. "Fact or artifact: The impact of measurement errors on the farm size–productivity relationship," Journal of Development Economics, Elsevier, vol. 103(C), pages 254-261.
    7. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    8. Abay, Kibrom A. & Abate, Gashaw T. & Barrett, Christopher B. & Bernard, Tanguy, 2019. "Correlated non-classical measurement errors, ‘Second best’ policy inference, and the inverse size-productivity relationship in agriculture," Journal of Development Economics, Elsevier, vol. 139(C), pages 171-184.
    9. Kilic, Talip & Moylan, Heather & Ilukor, John & Mtengula, Clement & Pangapanga-Phiri, Innocent, 2021. "Root for the tubers: Extended-harvest crop production and productivity measurement in surveys," Food Policy, Elsevier, vol. 102(C).
    10. Brzozowski, Matthew & Crossley, Thomas F. & Winter, Joachim K., 2017. "A comparison of recall and diary food expenditure data," Food Policy, Elsevier, vol. 72(C), pages 53-61.
    11. Das, Jishnu & Hammer, Jeffrey & Sánchez-Paramo, Carolina, 2012. "The impact of recall periods on reported morbidity and health seeking behavior," Journal of Development Economics, Elsevier, vol. 98(1), pages 76-88.
    12. Ashour, Maha & Billings, Lucy & Gilligan, Daniel & Hoel, Jessica B. & Karachiwalla, Naureen, 2016. "Do beliefs about agricultural inputs counterfeiting correspond with actual rates of counterfeiting? Evidence from Uganda:," IFPRI discussion papers 1552, International Food Policy Research Institute (IFPRI).
    13. Backiny-Yetna,Prospere R. & Yacoubou Djima,Ismael & Steele,Diane E. & Backiny-Yetna,Prospere R. & Yacoubou Djima,Ismael & Steele,Diane E., 2014. "The impact of household food consumption data collection methods on poverty and inequality measures in Niger," Policy Research Working Paper Series 7090, The World Bank.
    14. De Groote, Hugo & Traore, Oumar, 2005. "The cost of accuracy in crop area estimation," Agricultural Systems, Elsevier, vol. 84(1), pages 21-38, April.
    15. Deininger, Klaus & Carletto, Calogero & Savastano, Sara & Muwonge, James, 2012. "Can diaries help in improving agricultural production statistics? Evidence from Uganda," Journal of Development Economics, Elsevier, vol. 98(1), pages 42-50.
    16. Zezza, Alberto & Federighi, Giovanni & Kalilou, Amadou Adamou & Hiernaux, Pierre, 2016. "Milking the data: Measuring milk off-take in extensive livestock systems. Experimental evidence from Niger," Food Policy, Elsevier, vol. 59(C), pages 174-186.
    17. John Roberts & Devon Brewer, 2001. "Measures and tests of heaping in discrete quantitative distributions," Journal of Applied Statistics, Taylor & Francis Journals, vol. 28(7), pages 887-896.
    18. de Mel, Suresh & McKenzie, David J. & Woodruff, Christopher, 2009. "Measuring microenterprise profits: Must we ask how the sausage is made?," Journal of Development Economics, Elsevier, vol. 88(1), pages 19-31, January.
    19. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    20. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2015. "Household Surveys in Crisis," Journal of Economic Perspectives, American Economic Association, vol. 29(4), pages 199-226, Fall.
    21. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    22. Tessa Bold & Kayuki C. Kaizzi & Jakob Svensson & David Yanagizawa-Drott, 2017. "Lemon Technologies and Adoption: Measurement, Theory and Evidence from Agricultural Markets in Uganda," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(3), pages 1055-1100.
    23. Zezza, Alberto & Carletto, Calogero & Fiedler, John L. & Gennari, Pietro & Jolliffe, Dean, 2017. "Food counts. Measuring food consumption and expenditures in household consumption and expenditure surveys (HCES). Introduction to the special issue," Food Policy, Elsevier, vol. 72(C), pages 1-6.
    24. Gourlay,Sydney & Kilic,Talip & Lobell,David & Gourlay,Sydney & Kilic,Talip & Lobell,David, 2017. "Could the debate be over ? errors in farmer-reported production and their implications for the inverse scale-productivity relationship in Uganda," Policy Research Working Paper Series 8192, The World Bank.
    25. Desiere, Sam & Jolliffe, Dean, 2018. "Land productivity and plot size: Is measurement error driving the inverse relationship?," Journal of Development Economics, Elsevier, vol. 130(C), pages 84-98.
    26. repec:mpr:mprres:4832 is not listed on IDEAS
    27. Andrew Dillon & Sydney Gourlay & Kevin McGee & Gbemisola Oseni, 2019. "Land Measurement Bias and Its Empirical Implications: Evidence from a Validation Exercise," Economic Development and Cultural Change, University of Chicago Press, vol. 67(3), pages 595-624.
    28. Gourlay, Sydney & Kilic, Talip & Lobell, David B., 2019. "A new spin on an old debate: Errors in farmer-reported production and their implications for inverse scale - Productivity relationship in Uganda," Journal of Development Economics, Elsevier, vol. 141(C).
    29. Backiny-Yetna, Prospère & Steele, Diane & Yacoubou Djima, Ismael, 2017. "The impact of household food consumption data collection methods on poverty and inequality measures in Niger," Food Policy, Elsevier, vol. 72(C), pages 7-19.
    30. Gollin, Douglas, 2019. "IFAD RESEARCH SERIES 34 - Farm size and productivity: lessons from recent literature," IFAD Research Series 281567, International Fund for Agricultural Development (IFAD).
    31. Zezza, Alberto & Carletto, Gero & Fiedler, John L & Gennari, Pietro & Jolliffe, Dean M, 2017. "Food Counts. Measuring Food Consumption And Expenditures In Household Consumption And Expenditure Surveys (HCES)," 2017 International Congress, August 28-September 1, 2017, Parma, Italy 260886, European Association of Agricultural Economists.
    32. Engle-Stone, Reina & Sununtnasuk, Celeste & Fiedler, John L., 2017. "Investigating the significance of the data collection period of household consumption and expenditures surveys for food and nutrition policymaking: Analysis of the 2010 Bangladesh household income and," Food Policy, Elsevier, vol. 72(C), pages 72-80.
    33. Seymour,Greg & Malapit,Hazel Jean & Quisumbing,Agnes R., 2017. "Measuring time use in development settings," Policy Research Working Paper Series 8147, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sibhatu, Kibrom T. & Steinhübel, Linda & Siregar, Hermanto & Qaim, Matin & Wollni, Meike, 2022. "Spatial heterogeneity in smallholder oil palm production," Forest Policy and Economics, Elsevier, vol. 139(C).
    2. Kalaj, Jozefina & Rogger, Daniel & Somani, Ravi, 2022. "Bureaucrat time-use: Evidence from a survey experiment," World Development, Elsevier, vol. 152(C).
    3. Elena Serfilippi & Daniele Giovannucci & David Ameyaw & Ankur Bansal & Thomas Asafua Nketsia Wobill & Roberta Blankson & Rashi Mishra, 2022. "Benefits and Challenges of Making Data More Agile: A Review of Recent Key Approaches in Agriculture," Sustainability, MDPI, vol. 14(24), pages 1-18, December.
    4. Adzawla, William & Setsoafia, Edinam D. & Setsoafia, Eugene D. & Amoabeng-Nimako, Solomon & Atakora, Williams K. & Bindraban, Prem D., 2024. "Accuracy of agricultural data and implications for policy: Evidence from maize farmer recall surveys and crop cuts in the Guinea Savannah zone of Ghana," Agricultural Systems, Elsevier, vol. 214(C).
    5. Jung, Suhyun & Hajjar, Reem, 2023. "The livelihood impacts of transnational aid for climate change mitigation: Evidence from Ghana," Forest Policy and Economics, Elsevier, vol. 155(C).
    6. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    7. Abay, Kibrom A. & Barrett, Christopher B. & Kilic, Talip & Moylan, Heather & Ilukor, John & Vundru, Wilbert Drazi, 2023. "Nonclassical measurement error and farmers’ response to information treatment," Journal of Development Economics, Elsevier, vol. 164(C).
    8. Abay,Kibrom A. & Barrett,Christopher B. & Kilic,Talip & Moylan,Heather G. & Ilukor,John & Vundru,Wilbert Drazi, 2022. "Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies," Policy Research Working Paper Series 9908, The World Bank.
    9. Hossain, Marup & Mullally, Conner & Mabiso, Athur, 2024. "Occupational and asset adjustments in Tamil Nadu, India: The role of a finance and rebuilding program," World Development, Elsevier, vol. 177(C).
    10. Giefer, Madeline M. & An, Li, 2022. "Divergent impacts of the grain to green program, landholdings, and demographic factors on livelihood diversification in rural China," World Development, Elsevier, vol. 156(C).
    11. Funjika, Patricia & Getachew, Yoseph Y., 2022. "Colonial origin, ethnicity and intergenerational mobility in Africa," World Development, Elsevier, vol. 153(C).
    12. Abay,Kibrom A. & Barrett,Christopher B. & Kilic,Talip & Moylan,Heather G. & Ilukor,John & Vundru,Wilbert Drazi, 2022. "Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies," Policy Research Working Paper Series 9908, The World Bank.
    13. Markhof,Yannick Valentin & Ponzini,Giulia & Wollburg,Philip Randolph, 2022. "Measuring Disaster Crop Production Losses Using Survey Microdata : Evidence from Sub-Saharan Africa," Policy Research Working Paper Series 9968, The World Bank.
    14. Brooks, Mark & Lippe, Rattiya S. & Waibel, Hermann, 2021. "PAPI is gone, but errors remain: Non-sampling errors in household surveys," 2021 Conference, August 17-31, 2021, Virtual 315277, International Association of Agricultural Economists.
    15. Marup Hossain & Tisorn Songsermsawas & Robinson H. Toguem, 2024. "The role of access to finance in disaster recovery: Evidence from coastal communities in India," Journal of Agricultural Economics, Wiley Blackwell, vol. 75(1), pages 218-234, February.
    16. Banchayehu Tessema Assefa & Jordan Chamberlin & Martin K. van Ittersum & Pytrik Reidsma, 2021. "Usage and Impacts of Technologies and Management Practices in Ethiopian Smallholder Maize Production," Agriculture, MDPI, vol. 11(10), pages 1-19, September.
    17. Yacoubou Djima, Ismael & Kilic, Talip, 2024. "Attenuating measurement errors in agricultural productivity analysis by combining objective and self-reported survey data," Journal of Development Economics, Elsevier, vol. 168(C).
    18. Khonje, Makaiko G. & Nyondo, Christone & Mangisoni, Julius H. & Ricker-Gilbert, Jacob & Burke, William J. & Chadza, William & Muyanga, Milu, 2022. "Does subsidizing legume seeds improve farm productivity and nutrition in Malawi?," Food Policy, Elsevier, vol. 113(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:lic:licosd:41819 is not listed on IDEAS
    2. Kilic, Talip & Moylan, Heather & Ilukor, John & Mtengula, Clement & Pangapanga-Phiri, Innocent, 2021. "Root for the tubers: Extended-harvest crop production and productivity measurement in surveys," Food Policy, Elsevier, vol. 102(C).
    3. Abay,Kibrom A. & Barrett,Christopher B. & Kilic,Talip & Moylan,Heather G. & Ilukor,John & Vundru,Wilbert Drazi, 2022. "Nonclassical Measurement Error and Farmers’ Response to Information Reveal Behavioral Anomalies," Policy Research Working Paper Series 9908, The World Bank.
    4. Abate, Gashaw T. & de Brauw, Alan & Hirvonen, Kalle & Wolle, Abdulazize, 2023. "Measuring consumption over the phone: Evidence from a survey experiment in urban Ethiopia," Journal of Development Economics, Elsevier, vol. 161(C).
    5. Kosmowski, Frederic & Chamberlin, Jordan & Ayalew, Hailemariam & Sida, Tesfaye & Abay, Kibrom & Craufurd, Peter, 2021. "How accurate are yield estimates from crop cuts? Evidence from smallholder maize farms in Ethiopia," Food Policy, Elsevier, vol. 102(C).
    6. Abay, Kibrom A. & Abate, Gashaw T. & Barrett, Christopher B. & Bernard, Tanguy, 2019. "Correlated non-classical measurement errors, ‘Second best’ policy inference, and the inverse size-productivity relationship in agriculture," Journal of Development Economics, Elsevier, vol. 139(C), pages 171-184.
    7. Calogero Carletto, 2021. "Better data, higher impact: improving agricultural data systems for societal change [Correlated non-classical measurement errors, ‘second best’ policy inference, and the inverse size-productivity r," European Review of Agricultural Economics, Oxford University Press and the European Agricultural and Applied Economics Publications Foundation, vol. 48(4), pages 719-740.
    8. Zezza,Alberto & Mcgee,Kevin Robert & Wollburg,Philip Randolph & Assefa,Thomas Woldu & Gourlay,Sydney, 2022. "From Necessity to Opportunity : Lessons for Integrating Phone and In-Person Data Collectionfor Agricultural Statistics in a Post-Pandemic World," Policy Research Working Paper Series 10168, The World Bank.
    9. Carletto,Calogero & Dillon,Andrew S. & Zezza,Alberto, 2021. "Agricultural Data Collection to Minimize Measurement Error and Maximize Coverage," Policy Research Working Paper Series 9745, The World Bank.
    10. Abay, Kibrom A. & Barrett, Christopher B. & Kilic, Talip & Moylan, Heather & Ilukor, John & Vundru, Wilbert Drazi, 2023. "Nonclassical measurement error and farmers’ response to information treatment," Journal of Development Economics, Elsevier, vol. 164(C).
    11. Yacoubou Djima, Ismael & Kilic, Talip, 2024. "Attenuating measurement errors in agricultural productivity analysis by combining objective and self-reported survey data," Journal of Development Economics, Elsevier, vol. 168(C).
    12. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    13. Mensah, Edouard R. & Kostandini, Genti, 2020. "The inverse farm size-productivity relationship under land size mis-measurement and in the presence of weather and price risks: Panel data evidence from Uganda," 2020 Annual Meeting, July 26-28, Kansas City, Missouri 304477, Agricultural and Applied Economics Association.
    14. Chaoran Chen & Diego Restuccia & Raül Santaeulàlia-Llopis, 2023. "Land Misallocation and Productivity," American Economic Journal: Macroeconomics, American Economic Association, vol. 15(2), pages 441-465, April.
    15. Kibrom A. Abay & Leah E. M. Bevis & Christopher B. Barrett, 2021. "Measurement Error Mechanisms Matter: Agricultural Intensification with Farmer Misperceptions and Misreporting," American Journal of Agricultural Economics, John Wiley & Sons, vol. 103(2), pages 498-522, March.
    16. Helfand, Steven M. & Taylor, Matthew P.H., 2021. "The inverse relationship between farm size and productivity: Refocusing the debate," Food Policy, Elsevier, vol. 99(C).
    17. Zezza, Alberto & Carletto, Calogero & Fiedler, John L. & Gennari, Pietro & Jolliffe, Dean, 2017. "Food counts. Measuring food consumption and expenditures in household consumption and expenditure surveys (HCES). Introduction to the special issue," Food Policy, Elsevier, vol. 72(C), pages 1-6.
    18. Elena Serfilippi & Daniele Giovannucci & David Ameyaw & Ankur Bansal & Thomas Asafua Nketsia Wobill & Roberta Blankson & Rashi Mishra, 2022. "Benefits and Challenges of Making Data More Agile: A Review of Recent Key Approaches in Agriculture," Sustainability, MDPI, vol. 14(24), pages 1-18, December.
    19. de Nicola, Francesca & Giné, Xavier, 2014. "How accurate are recall data? Evidence from coastal India," Journal of Development Economics, Elsevier, vol. 106(C), pages 52-65.
    20. Dang, Hai-Anh H & Carletto, Calogero, 2022. "Recall Bias Revisited: Measure Farm Labor Using Mixed-Mode Surveys and Multiple Imputation," IZA Discussion Papers 14997, Institute of Labor Economics (IZA).
    21. Wossen, Tesfamicheal & Abay, Kibrom A. & Abdoulaye, Tahirou, 2022. "Misperceiving and misreporting input quality: Implications for input use and productivity," Journal of Development Economics, Elsevier, vol. 157(C).

    More about this item

    Keywords

    Food Security; Crops and Crop Management Systems; Climate Change and Agriculture; Educational Sciences; Gender and Development; Inequality;
    All these keywords.

    JEL classification:

    • Q12 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Micro Analysis of Farm Firms, Farm Households, and Farm Input Markets
    • Q18 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Agricultural Policy; Food Policy; Animal Welfare Policy
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:9128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.