IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v99y2024ics0272775724000128.html
   My bibliography  Save this article

The impact of combining performance-management tools and training with diagnostic feedback in public schools: Experimental evidence from Argentina

Author

Listed:
  • de Hoyos, Rafael
  • Djaker, Sharnic
  • Ganimian, Alejandro J.
  • Holland, Peter A.

Abstract

Providing principals with low-stakes information on their students’ test scores has been shown to improve school management, instruction, and achievement in upper-middle income countries. We evaluate this approach by itself (“diagnostic feedback” or T1) and combined with tools and training (“performance management” or T2) through an experiment in 396 public primary schools in Salta, Argentina. After two years, T1 had null or adverse effects on students’ performance in school, but T2 reduced grade repetition (especially, among cohorts with more exposure), even a year after the interventions ended. We cannot rule out small-to-moderate effects on achievement. T2 also impacted teacher quality, student beliefs, bullying and discrimination, and extracurricular activities for high-exposure cohorts. Our results suggest that tools and training can effectively complement information in contexts of low principal capacity.

Suggested Citation

  • de Hoyos, Rafael & Djaker, Sharnic & Ganimian, Alejandro J. & Holland, Peter A., 2024. "The impact of combining performance-management tools and training with diagnostic feedback in public schools: Experimental evidence from Argentina," Economics of Education Review, Elsevier, vol. 99(C).
    • Handle: RePEc:eee:ecoedu:v:99:y:2024:i:c:s0272775724000128
    DOI: 10.1016/j.econedurev.2024.102518
    as

    Download full text from publisher

    File URL: https://www.sciencedirect.com/science/article/pii/S0272775724000128
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.econedurev.2024.102518?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Parag A. Pathak & Christopher R. Walters, 2013. "Explaining Charter School Effectiveness," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 1-27, October.
    2. Gérard Lassibille & Jee-Peng Tan & Cornelia Jesse & Trang Van Nguyen, 2010. "Managing for Results in Primary Education in Madagascar: Evaluating the Impact of Selected Workflow Interventions," The World Bank Economic Review, World Bank, vol. 24(2), pages 303-329, August.
    3. Nazmul Chaudhury & Jeffrey Hammer & Michael Kremer & Karthik Muralidharan & F. Halsey Rogers, 2006. "Missing in Action: Teacher and Health Worker Absence in Developing Countries," Journal of Economic Perspectives, American Economic Association, vol. 20(1), pages 91-116, Winter.
    4. Ganimian, A. J., 2009. "How Much Are Latin American Children Learning? Highlights from the Second Regional Student Achievement Test (SERCE)," Working Paper 38411, Harvard University OpenScholar.
    5. Nicholas Bloom & Renata Lemos & Raffaella Sadun & John Van Reenen, 2015. "Does Management Matter in schools?," Economic Journal, Royal Economic Society, vol. 0(584), pages 647-674, May.
    6. Clare Leaver & Renata Lemos & Daniela Scur, 2019. "Measuring and explaining management in schools: new approaches using public data," CEP Discussion Papers dp1656, Centre for Economic Performance, LSE.
    7. Will Dobbie & Roland G. Fryer Jr., 2013. "Getting beneath the Veil of Effective Schools: Evidence from New York City," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 28-60, October.
    8. Andrews, Matt & Pritchett, Lant & Woolcock, Michael, 2017. "Building State Capability: Evidence, Analysis, Action," OUP Catalogue, Oxford University Press, number 9780198747482.
    9. Renata Lemos & Karthik Muralidharan & Daniela Scur, 2024. "Personnel Management and School Productivity: Evidence from India," The Economic Journal, Royal Economic Society, vol. 134(661), pages 2071-2100.
    10. Ganimian, A. J., 2015. "Pistas hechas en Latinoame?rica ¿Que? hicieron los pai?ses, escuelas y estudiantes con mejor desempen?o en el Tercer Estudio Regional Comparativo y Explicativo (TERCE)?," Working Paper 345821, Harvard University OpenScholar.
    11. Mauricio Romero & Justin Sandefur & Wayne Aaron Sandholtz, 2020. "Outsourcing Education: Experimental Evidence from Liberia," American Economic Review, American Economic Association, vol. 110(2), pages 364-400, February.
    12. Anand, Gautam & Atluri, Aishwarya & Crawfurd, Lee & Pugatch, Todd & Sheth, Ketki, 2023. "Improving school management in low and middle income countries: A systematic review," Economics of Education Review, Elsevier, vol. 97(C).
    13. Muralidharan, Karthik & Das, Jishnu & Holla, Alaka & Mohpal, Aakash, 2017. "The fiscal cost of weak governance: Evidence from teacher absence in India," Journal of Public Economics, Elsevier, vol. 145(C), pages 116-135.
    14. Lee Crawfurd, 2017. "School Management and Public–Private Partnerships in Uganda," Journal of African Economies, Centre for the Study of African Economies, vol. 26(5), pages 539-560.
    15. de Hoyos, Rafael & Garcia-Moreno, Vicente A. & Patrinos, Harry Anthony, 2017. "The impact of an accountability intervention with diagnostic feedback: Evidence from Mexico," Economics of Education Review, Elsevier, vol. 58(C), pages 123-140.
    16. Elizabeth Dhuey & Justin Smith, 2014. "How important are school principals in the production of student achievement?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 47(2), pages 634-663, May.
    17. Gregory F. Branch & Eric A. Hanushek & Steven G. Rivkin, 2012. "Estimating the Effect of Leaders on Public Sector Productivity: The Case of School Principals," NBER Working Papers 17803, National Bureau of Economic Research, Inc.
    18. Karthik Muralidharan & Venkatesh Sundararaman, 2010. "The Impact of Diagnostic Feedback to Teachers on Student Learning: Experimental Evidence from India," Economic Journal, Royal Economic Society, vol. 120(546), pages 187-203, August.
    19. Garcia Moreno,Vicente A. & Gertler,Paul J. & Patrinos,Harry Anthony, 2019. "School-Based Management and Learning Outcomes : Experimental Evidence from Colima, Mexico," Policy Research Working Paper Series 8874, The World Bank.
    20. Blimpo,Moussa P. & Evans,David & Lahire,Nathalie, 2015. "Parental human capital and effective school management : evidence from The Gambia," Policy Research Working Paper Series 7238, The World Bank.
    21. Atila Abdulkadiroğlu & Joshua D. Angrist & Peter D. Hull & Parag A. Pathak, 2016. "Charters without Lotteries: Testing Takeovers in New Orleans and Boston," American Economic Review, American Economic Association, vol. 106(7), pages 1878-1920, July.
    22. Sarah R. Cohodes & Elizabeth M. Setren & Christopher R. Walters, 2021. "Can Successful Schools Replicate? Scaling Up Boston's Charter School Sector," American Economic Journal: Economic Policy, American Economic Association, vol. 13(1), pages 138-167, February.
    23. Ganimian, A. J., 2015. "El termómetro educativo: Informe sobre el desempeño de Argentina en los Operativos Nacionales de Evaluación (ONE) 2005-2013," Working Paper 257736, Harvard University OpenScholar.
    24. Rafael de Hoyos & Alejandro J Ganimian & Peter A Holland, 2021. "Teaching with the Test: Experimental Evidence on Diagnostic Feedback and Capacity Building for Public Schools in Argentina," The World Bank Economic Review, World Bank, vol. 35(2), pages 499-520.
    25. Harsha Aturupane & Paul Glewwe & Tomoko Utsumi & Suzanne Wisniewski & Mari Shojo, 2022. "The impact of Sri lanka’s school-based management programme on teachers’ pedagogical practices and student learning: evidence from a randomised controlled trial," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 14(4), pages 285-305, October.
    26. Derek Laing & Steven G. Rivkin & Jeffrey C. Schiman & Jason Ward, 2016. "Decentralized Governance and the Quality of School Leadership," NBER Working Papers 22061, National Bureau of Economic Research, Inc.
    27. Tavares, Priscilla Albuquerque, 2015. "The impact of school management practices on educational performance: Evidence from public schools in São Paulo," Economics of Education Review, Elsevier, vol. 48(C), pages 1-15.
    28. Coelli, Michael & Green, David A., 2012. "Leadership effects: school principals and student outcomes," Economics of Education Review, Elsevier, vol. 31(1), pages 92-109.
    29. Karthik Muralidharan & Abhijeet Singh, 2020. "Improving Public Sector Management at Scale? Experimental Evidence on School Governance India," NBER Working Papers 28129, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anand, Gautam & Atluri, Aishwarya & Crawfurd, Lee & Pugatch, Todd & Sheth, Ketki, 2023. "Improving school management in low and middle income countries: A systematic review," Economics of Education Review, Elsevier, vol. 97(C).
    2. Isaac Mbiti & Karthik Muralidharan & Mauricio Romero & Youdi Schipper & Constantine Manda & Rakesh Rajani, 2019. "Inputs, Incentives, and Complementarities in Education: Experimental Evidence from Tanzania," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1627-1673.
    3. Burgess, Simon, 2016. "Human Capital and Education: The State of the Art in the Economics of Education," IZA Discussion Papers 9885, Institute of Labor Economics (IZA).
    4. Lee Crawfurd, 2017. "School Management and Public–Private Partnerships in Uganda," Journal of African Economies, Centre for the Study of African Economies, vol. 26(5), pages 539-560.
    5. Romero, Mauricio & Bedoya, Juan & Yanez-Pagans, Monica & Silveyra, Marcela & de Hoyos, Rafael, 2022. "Direct vs indirect management training: Experimental evidence from schools in Mexico," Journal of Development Economics, Elsevier, vol. 154(C).
    6. Daniela Scur & Raffaella Sadun & John Van Reenen & Renata Lemos & Nicholas Bloom, 2021. "The World Management Survey at 18: lessons and the way forward," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 37(2), pages 231-258.
    7. Gabrielle Wills & Servaas van der Berg, 2018. "Measuring leadership and management and their linkages with literacy in rural and township primary schools in South Africa," Working Papers 21/2018, Stellenbosch University, Department of Economics.
    8. Bartanen, Brendan & Husain, Aliza N. & Liebowitz, David D., 2024. "Rethinking principal effects on student outcomes," Journal of Public Economics, Elsevier, vol. 234(C).
    9. Nicholas Bloom & Renata Lemos & Raffaella Sadun & John Van Reenen, 2015. "Does Management Matter in schools?," Economic Journal, Royal Economic Society, vol. 0(584), pages 647-674, May.
    10. Di Liberto, Adriana & Giua, Ludovica & Schivardi, Fabiano & Sideri, Marco & Sulis, Giovanni, 2023. "Managerial Practices and Student Performance: Evidence from Changes in School Principals," IZA Discussion Papers 16203, Institute of Labor Economics (IZA).
    11. Schiman, Jeffrey C., 2021. "The Information Content of Employee Awards," Economics of Education Review, Elsevier, vol. 84(C).
    12. Fazzio, Ila & Eble, Alex & Lumsdaine, Robin L. & Boone, Peter & Bouy, Baboucarr & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Johnson, Simon & Silva, Ana Filipa, 2021. "Large learning gains in pockets of extreme poverty: Experimental evidence from Guinea Bissau," Journal of Public Economics, Elsevier, vol. 199(C).
    13. Lorenzo Neri & Elisabetta Pasini, 2020. "Heterogeneous Effects of School Autonomy in England," Discussion Paper Series, School of Economics and Finance 202010, School of Economics and Finance, University of St Andrews.
    14. Chicas Romero,Mauricio & Bedoya,Juan & Yanez Pagans,Monica & Silveyra De La Garza,Marcela Lucia & De Hoyos Navarro,Rafael E., 2021. "School Management, Grants, and Test Scores : Experimental Evidence from Mexico," Policy Research Working Paper Series 9535, The World Bank.
    15. Eble, Alex & Frost, Chris & Camara, Alpha & Bouy, Baboucarr & Bah, Momodou & Sivaraman, Maitri & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Brady, Tony & Gawron, Piotr & Vansteelandt, Stijn & Boone, P, 2021. "How much can we remedy very low learning levels in rural parts of low-income countries? Impact and generalizability of a multi-pronged para-teacher intervention from a cluster-randomized trial in the ," Journal of Development Economics, Elsevier, vol. 148(C).
    16. Masci, Chiara & De Witte, Kristof & Agasisti, Tommaso, 2018. "The influence of school size, principal characteristics and school management practices on educational performance: An efficiency analysis of Italian students attending middle schools," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 52-69.
    17. Elizabeth Beasley & Elise Huillery, 2017. "Willing but Unable? Short-term Experimental Evidence on Parent Empowerment and School Quality," The World Bank Economic Review, World Bank, vol. 31(2), pages 531-552.
    18. Eyles, Andrew & Machin, Stephen & McNally, Sandra, 2017. "Unexpected school reform: Academisation of primary schools in England," Journal of Public Economics, Elsevier, vol. 155(C), pages 108-121.
    19. Jenifer Ruiz-Valenzuela & Camille Terrier & Clémentine Van Effenterre, 2017. "Effectiveness of CEOs in the public sector: evidence from further education institutions," CVER Briefing Notes 005, Centre for Vocational Education Research.
    20. Sandra McNally & Luis Schmidt & Anna Valero, 2024. "Do management practices matter in further education?," Economica, London School of Economics and Political Science, vol. 91(363), pages 740-769, July.

    More about this item

    Keywords

    Diagnostic feedback; Performance management; Professional development; School management; Student assessments; Argentina;
    All these keywords.

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • I25 - Health, Education, and Welfare - - Education - - - Education and Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:99:y:2024:i:c:s0272775724000128. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.