IDEAS home Printed from https://ideas.repec.org/p/egu/wpaper/2118.html
   My bibliography  Save this paper

Technological breakthroughs in European regions: the role of related and unrelated combinations

Author

Listed:
  • Ron Boschma
  • Ernest Miguelez
  • Rosina Moreno
  • Diego B. Ocampo-Corrales

Abstract

This paper analyzes if the emergence and occurrence of breakthrough technologies in 277 European regions in the period 1981 to 2010 is related to the existing technological portfolio of regions. The study shows that, by far, most combinations breakthrough inventions make are between related technologies: almost no breakthrough patent makes combinations between unrelated combinations only. We also find that breakthrough inventions primarily combine and cite technological classes that are present in the region. Regressions show that the occurrence of breakthrough patents in a technology in a region is positively affected by the local stock of technologies that is related to such technology, but we do not find such an effect for the local stock of unrelated technologies, in contrast to studies that suggest otherwise. However, the region’s ability to enter new breakthrough inventions in a technology relies on the combination of knowledge that is both related and unrelated to such technology.

Suggested Citation

  • Ron Boschma & Ernest Miguelez & Rosina Moreno & Diego B. Ocampo-Corrales, 2021. "Technological breakthroughs in European regions: the role of related and unrelated combinations," Papers in Evolutionary Economic Geography (PEEG) 2118, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Jun 2021.
  • Handle: RePEc:egu:wpaper:2118
    as

    Download full text from publisher

    File URL: https://econ.geo.uu.nl/peeg/peeg2118.pdf
    File Function: Version June 2021
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bettencourt, Luis M.A. & Lobo, Jose & Strumsky, Deborah, 2007. "Invention in the city: Increasing returns to patenting as a scaling function of metropolitan size," Research Policy, Elsevier, vol. 36(1), pages 107-120, February.
    2. Joan Crespo & Raphael Suire & Jerome Vicente, 2014. "Lock-in or lock-out? How structural properties of knowledge networks affect regional resilience," Journal of Economic Geography, Oxford University Press, vol. 14(1), pages 199-219, January.
    3. Fritsch, Michael & Wyrwich, Michael, 2021. "Is innovation (increasingly) concentrated in large cities? An international comparison," Research Policy, Elsevier, vol. 50(6).
    4. Artur Santoalha & Ron Boschma, 2021. "Diversifying in green technologies in European regions: does political support matter?," Regional Studies, Taylor & Francis Journals, vol. 55(2), pages 182-195, February.
    5. Aarstad, Jarle & Kvitastein, Olav A. & Jakobsen, Stig-Erik, 2016. "Related and unrelated variety as regional drivers of enterprise productivity and innovation: A multilevel study," Research Policy, Elsevier, vol. 45(4), pages 844-856.
    6. Nils Grashof & Kolja Hesse & Dirk Fornahl, 2019. "Radical or not? The role of clusters in the emergence of radical innovations," European Planning Studies, Taylor & Francis Journals, vol. 27(10), pages 1904-1923, October.
    7. James G. March, 1991. "Exploration and Exploitation in Organizational Learning," Organization Science, INFORMS, vol. 2(1), pages 71-87, February.
    8. William R. Kerr, 2010. "Breakthrough Inventions and Migrating Clusters of Innovation," NBER Chapters, in: Cities and Entrepreneurship, National Bureau of Economic Research, Inc.
    9. Boschma, Ron & Heimeriks, Gaston & Balland, Pierre-Alexandre, 2014. "Scientific knowledge dynamics and relatedness in biotech cities," Research Policy, Elsevier, vol. 43(1), pages 107-114.
    10. Manuel Trajtenberg, 1990. "A Penny for Your Quotes: Patent Citations and the Value of Innovations," RAND Journal of Economics, The RAND Corporation, vol. 21(1), pages 172-187, Spring.
    11. Wang, Jian & Veugelers, Reinhilde & Stephan, Paula, 2017. "Bias against novelty in science: A cautionary tale for users of bibliometric indicators," Research Policy, Elsevier, vol. 46(8), pages 1416-1436.
    12. Ron Boschma & Asier Minondo & Mikel Navarro, 2013. "The Emergence of New Industries at the Regional Level in S pain: A Proximity Approach Based on Product Relatedness," Economic Geography, Taylor & Francis Journals, vol. 89(1), pages 29-51, January.
    13. William Arant & Dirk Fornahl & Nils Grashof & Kolja Hesse & Cathrin Söllner, 2019. "University-industry collaborations—The key to radical innovations? [Universität-Industrie-Kooperationen – Der Schlüssel zu radikalen Innovationen?]," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 39(2), pages 119-141, October.
    14. Bronwyn H. Hall & Adam Jaffe & Manuel Trajtenberg, 2005. "Market Value and Patent Citations," RAND Journal of Economics, The RAND Corporation, vol. 36(1), pages 16-38, Spring.
    15. Adam B. Jaffe & Manuel Trajtenberg & Rebecca Henderson, 1993. "Geographic Localization of Knowledge Spillovers as Evidenced by Patent Citations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(3), pages 577-598.
    16. Verhoeven, Dennis & Bakker, Jurriën & Veugelers, Reinhilde, 2016. "Measuring technological novelty with patent-based indicators," Research Policy, Elsevier, vol. 45(3), pages 707-723.
    17. Mikhail Martynovich & Josef Taalbi, 2020. "Related variety, recombinant knowledge and regional innovation. Evidence for Sweden, 1991-2010," Papers in Evolutionary Economic Geography (PEEG) 2015, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Mar 2020.
    18. Kolja Hesse & Dirk Fornahl, 2020. "Essential ingredients for radical innovations? The role of (un‐)related variety and external linkages in Germany," Papers in Regional Science, Wiley Blackwell, vol. 99(5), pages 1165-1183, October.
    19. Pierre-Alexandre Balland & Ron Boschma, 2021. "Complementary interregional linkages and Smart Specialisation: an empirical study on European regions," Regional Studies, Taylor & Francis Journals, vol. 55(6), pages 1059-1070, June.
    20. Carolina Castaldi & Koen Frenken & Bart Los, 2015. "Related Variety, Unrelated Variety and Technological Breakthroughs: An analysis of US State-Level Patenting," Regional Studies, Taylor & Francis Journals, vol. 49(5), pages 767-781, May.
    21. Ron Boschma, 2017. "Relatedness as driver of regional diversification: a research agenda," Regional Studies, Taylor & Francis Journals, vol. 51(3), pages 351-364, March.
    22. Carlino, Gerald A. & Chatterjee, Satyajit & Hunt, Robert M., 2007. "Urban density and the rate of invention," Journal of Urban Economics, Elsevier, vol. 61(3), pages 389-419, May.
    23. C. A. Hidalgo & B. Klinger & A. -L. Barabasi & R. Hausmann, 2007. "The Product Space Conditions the Development of Nations," Papers 0708.2090, arXiv.org.
    24. Zoltan J. Acs & Luc Anselin & Attila Varga, 2008. "Patents and Innovation Counts as Measures of Regional Production of New Knowledge," Chapters, in: Entrepreneurship, Growth and Public Policy, chapter 11, pages 135-151, Edward Elgar Publishing.
    25. Audretsch, David B. & Feldman, Maryann P., 2004. "Knowledge spillovers and the geography of innovation," Handbook of Regional and Urban Economics, in: J. V. Henderson & J. F. Thisse (ed.), Handbook of Regional and Urban Economics, edition 1, volume 4, chapter 61, pages 2713-2739, Elsevier.
    26. Sarah Kaplan & Keyvan Vakili, 2015. "The double-edged sword of recombination in breakthrough innovation," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1435-1457, October.
    27. Sam Tavassoli & Nunzia Carbonara, 2014. "The role of knowledge variety and intensity for regional innovation," Small Business Economics, Springer, vol. 43(2), pages 493-509, August.
    28. Nicola Cortinovis & Jing Xiao & Ron Boschma & Frank G van Oort, 2017. "Quality of government and social capital as drivers of regional diversification in Europe," Journal of Economic Geography, Oxford University Press, vol. 17(6), pages 1179-1208.
    29. Deyu Li & Gaston Heimeriks & Floor Alkemade, 2021. "Recombinant invention in solar photovoltaic technology: can geographical proximity bridge technological distance?," Regional Studies, Taylor & Francis Journals, vol. 55(4), pages 605-616, April.
    30. Lars Mewes, 2018. "Scaling of Atypical Knowledge Combinations in American Metropolitan Areas from 1836 to 2010," Papers in Evolutionary Economic Geography (PEEG) 1841, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Nov 2018.
    31. Jose-Luis Hervás-Oliver & Jose Albors-Garrigos & Sofia Estelles-Miguel & Carles Boronat-Moll, 2018. "Radical innovation in Marshallian industrial districts," Regional Studies, Taylor & Francis Journals, vol. 52(10), pages 1388-1397, October.
    32. Strumsky, Deborah & Lobo, José, 2015. "Identifying the sources of technological novelty in the process of invention," Research Policy, Elsevier, vol. 44(8), pages 1445-1461.
    33. Jung Won Sonn & Michael Storper, 2008. "The Increasing Importance of Geographical Proximity in Knowledge Production: An Analysis of US Patent Citations, 1975–1997," Environment and Planning A, , vol. 40(5), pages 1020-1039, May.
    34. Boschma, Ron & Capone, Gianluca, 2015. "Institutions and diversification: Related versus unrelated diversification in a varieties of capitalism framework," Research Policy, Elsevier, vol. 44(10), pages 1902-1914.
    35. Ron Boschma, 2017. "Relatedness as driver behind regional diversification: a research agenda," Papers in Evolutionary Economic Geography (PEEG) 1702, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Jan 2017.
    36. van Eck, N.J.P. & Waltman, L., 2009. "How to Normalize Co-Occurrence Data? An Analysis of Some Well-Known Similarity Measures," ERIM Report Series Research in Management ERS-2009-001-LIS, Erasmus Research Institute of Management (ERIM), ERIM is the joint research institute of the Rotterdam School of Management, Erasmus University and the Erasmus School of Economics (ESE) at Erasmus University Rotterdam.
    37. Lars Mewes, 2019. "Scaling of Atypical Knowledge Combinations in American Metropolitan Areas from 1836 to 2010," Economic Geography, Taylor & Francis Journals, vol. 95(4), pages 341-361, August.
    38. Abbasiharofteh, Milad & Kogler, Dieter F. & Lengyel, Balázs, 2023. "Atypical combinations of technologies in regional co-inventor networks," Research Policy, Elsevier, vol. 52(10).
    39. Breschi, Stefano & Lissoni, Francesco & Malerba, Franco, 2003. "Knowledge-relatedness in firm technological diversification," Research Policy, Elsevier, vol. 32(1), pages 69-87, January.
    40. Attila Varga, 2000. "Local Academic Knowledge Transfers and the Concentration of Economic Activity," Journal of Regional Science, Wiley Blackwell, vol. 40(2), pages 289-309, May.
    41. Enrico Berkes & Ruben Gaetani, 2021. "The Geography of Unconventional Innovation," The Economic Journal, Royal Economic Society, vol. 131(636), pages 1466-1514.
    42. Koen Frenken & Frank Van Oort & Thijs Verburg, 2007. "Related Variety, Unrelated Variety and Regional Economic Growth," Regional Studies, Taylor & Francis Journals, vol. 41(5), pages 685-697.
    43. Dahlin, Kristina B. & Behrens, Dean M., 2005. "When is an invention really radical?: Defining and measuring technological radicalness," Research Policy, Elsevier, vol. 34(5), pages 717-737, June.
    44. Gautam Ahuja & Curba Morris Lampert, 2001. "Entrepreneurship in the large corporation: a longitudinal study of how established firms create breakthrough inventions," Strategic Management Journal, Wiley Blackwell, vol. 22(6‐7), pages 521-543, June.
    45. Dosi, Giovanni, 1993. "Technological paradigms and technological trajectories : A suggested interpretation of the determinants and directions of technical change," Research Policy, Elsevier, vol. 22(2), pages 102-103, April.
    46. Sandro Montresor & Francesco Quatraro, 2017. "Regional Branching and Key Enabling Technologies: Evidence from European Patent Data," Economic Geography, Taylor & Francis Journals, vol. 93(4), pages 367-396, August.
    47. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    48. Manuel Trajtenberg & Rebecca Henderson & Adam Jaffe, 1997. "University Versus Corporate Patents: A Window On The Basicness Of Invention," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 5(1), pages 19-50.
    49. Schoenmakers, Wilfred & Duysters, Geert, 2010. "The technological origins of radical inventions," Research Policy, Elsevier, vol. 39(8), pages 1051-1059, October.
    50. Nees Jan van Eck & Ludo Waltman, 2009. "How to normalize cooccurrence data? An analysis of some well‐known similarity measures," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(8), pages 1635-1651, August.
    51. Pierre-Alexandre Balland & David Rigby, 2017. "The Geography of Complex Knowledge," Economic Geography, Taylor & Francis Journals, vol. 93(1), pages 1-23, January.
    52. Dietmar Harhoff & Francis Narin & F. M. Scherer & Katrin Vopel, 1999. "Citation Frequency And The Value Of Patented Inventions," The Review of Economics and Statistics, MIT Press, vol. 81(3), pages 511-515, August.
    53. Sam Arts & Reinhilde Veugelers, 2015. "Technology familiarity, recombinant novelty, and breakthrough invention," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 24(6), pages 1215-1246.
    54. Stefano Breschi & Francesco Lissoni, 2009. "Mobility of skilled workers and co-invention networks: an anatomy of localized knowledge flows," Journal of Economic Geography, Oxford University Press, vol. 9(4), pages 439-468, July.
    55. Kristina Dahlin & Deans M. Behrens, 2005. "When is an invention really radical? Defining and measuring technological radicalness," Post-Print hal-00480416, HAL.
    56. Pierre-Alexandre Balland & Ron Boschma & Joan Crespo & David L. Rigby, 2019. "Smart specialization policy in the European Union: relatedness, knowledge complexity and regional diversification," Regional Studies, Taylor & Francis Journals, vol. 53(9), pages 1252-1268, September.
    57. Castaldi, Carolina & Los, Bart, 2017. "Geographical patterns in US inventive activity 1977–1998: The “regional inversion” was underestimated," Research Policy, Elsevier, vol. 46(7), pages 1187-1197.
    58. Ron Boschma, 2005. "Proximity and Innovation: A Critical Assessment," Regional Studies, Taylor & Francis Journals, vol. 39(1), pages 61-74.
    59. Pier Saviotti & Koen Frenken, 2008. "Export variety and the economic performance of countries," Journal of Evolutionary Economics, Springer, vol. 18(2), pages 201-218, April.
    60. Jean O. Lanjouw & Mark Schankerman, 2004. "Patent Quality and Research Productivity: Measuring Innovation with Multiple Indicators," Economic Journal, Royal Economic Society, vol. 114(495), pages 441-465, April.
    61. Ivan De Noni & Fiorenza Belussi, 2021. "Breakthrough Invention Performance of Multispecialized Clustered Regions in Europe," Economic Geography, Taylor & Francis Journals, vol. 97(2), pages 164-186, March.
    62. Lee Fleming, 2001. "Recombinant Uncertainty in Technological Search," Management Science, INFORMS, vol. 47(1), pages 117-132, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Eva Coll-Martínez & Malia Kedjar & Patricia Renou-Maissant, 2022. "(Green) Knowledge spillovers and regional environmental support: do they matter for the entry of new green tech-based firms?," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 69(1), pages 119-161, August.
    2. Peter Mayerhofer, 2022. "Vorarlbergs Wirtschaft im europäischen Konkurrenzumfeld. Bericht zur internationalen Wettbewerbsfähigkeit 2022," WIFO Studies, WIFO, number 69424.
    3. Ernest Miguelez & Andrea Morrison, 2023. "Migrant inventors as agents of technological change," The Journal of Technology Transfer, Springer, vol. 48(2), pages 669-692, April.
    4. Ron Boschma, 2021. "Designing Smart Specialization Policy: relatedness, unrelatedness, or what?," Papers in Evolutionary Economic Geography (PEEG) 2128, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Sep 2021.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kolja Hesse & Dirk Fornahl, 2020. "Essential ingredients for radical innovations? The role of (un‐)related variety and external linkages in Germany," Papers in Regional Science, Wiley Blackwell, vol. 99(5), pages 1165-1183, October.
    2. Nils Grashof & Alexander Kopka, 2023. "Artificial intelligence and radical innovation: an opportunity for all companies?," Small Business Economics, Springer, vol. 61(2), pages 771-797, August.
    3. Sandro Montresor & Gianluca Orsatti & Francesco Quatraro, 2023. "Technological novelty and key enabling technologies: evidence from European regions," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 32(6), pages 851-872, August.
    4. Quatraro, Francesco & Scandura, Alessandra, 2020. "Regional patterns of unrelated technological diversification: the role of academic inventors," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 202001, University of Turin.
    5. Abbasiharofteh, Milad & Kogler, Dieter F. & Lengyel, Balázs, 2023. "Atypical combinations of technologies in regional co-inventor networks," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 52(10), pages 1-1.
    6. Kolja Hesse, 2020. "Related to whom? The impact of organisational and regional capabilities on radical breakthroughs," Bremen Papers on Economics & Innovation 2005, University of Bremen, Faculty of Business Studies and Economics.
    7. Apa, Roberta & De Noni, Ivan & Orsi, Luigi & Sedita, Silvia Rita, 2018. "Knowledge space oddity: How to increase the intensity and relevance of the technological progress of European regions," Research Policy, Elsevier, vol. 47(9), pages 1700-1712.
    8. William Arant & Dirk Fornahl & Nils Grashof & Kolja Hesse & Cathrin Söllner, 2019. "University-industry collaborations—The key to radical innovations? [Universität-Industrie-Kooperationen – Der Schlüssel zu radikalen Innovationen?]," Review of Regional Research: Jahrbuch für Regionalwissenschaft, Springer;Gesellschaft für Regionalforschung (GfR), vol. 39(2), pages 119-141, October.
    9. Pintar, Nico & Scherngell, Thomas, 2022. "The complex nature of regional knowledge production: Evidence on European regions," Research Policy, Elsevier, vol. 51(8).
    10. Dirk Fornahl & Nils Grashof & Alexander Kopka, 2021. "Do not neglect the periphery?! - the emergence and diffusion of radical innovations," Bremen Papers on Economics & Innovation 2102, University of Bremen, Faculty of Business Studies and Economics.
    11. Ernest Miguélez & Rosina Moreno, 2016. "“Relatedness, external linkages and innovation”," IREA Working Papers 201603, University of Barcelona, Research Institute of Applied Economics, revised Apr 2016.
    12. Barbieri, Nicolò & Marzucchi, Alberto & Rizzo, Ugo, 2020. "Knowledge sources and impacts on subsequent inventions: Do green technologies differ from non-green ones?," Research Policy, Elsevier, vol. 49(2).
    13. Deyu Li & Floor Alkemade & Koen Frenken & Gaston Heimeriks, 2023. "Catching up in clean energy technologies: a patent analysis," The Journal of Technology Transfer, Springer, vol. 48(2), pages 693-715, April.
    14. Hesse, Kolja, 2020. "Unlocking the radical potential of German innovators How can R&D policy foster radical innovation?," Papers in Innovation Studies 2020/5, Lund University, CIRCLE - Centre for Innovation Research.
    15. Sándor Juhász & Tom Broekel & Ron Boschma, 2021. "Explaining the dynamics of relatedness: The role of co‐location and complexity," Papers in Regional Science, Wiley Blackwell, vol. 100(1), pages 3-21, February.
    16. Pierre-Alexandre Balland & Ron Boschma & Joan Crespo & David L. Rigby, 2017. "Smart Specialization policy in the EU: Relatedness, Knowledge Complexity and Regional Diversification," Papers in Evolutionary Economic Geography (PEEG) 1717, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Jul 2017.
    17. Pinheiro, Flávio L. & Hartmann, Dominik & Boschma, Ron & Hidalgo, César A., 2022. "The time and frequency of unrelated diversification," Research Policy, Elsevier, vol. 51(8).
    18. Nils Grashof & Holger Graf, 2023. "Universities that matter for regional knowledge base renewal - the role of multilevel embeddedness," Jena Economics Research Papers 2023-009, Friedrich-Schiller-University Jena.
    19. Moreno, Rosina & Ocampo-Corrales, Diego, 2022. "The ability of European regions to diversify in renewable energies: The role of technological relatedness," Research Policy, Elsevier, vol. 51(5).
    20. Wolf-Hendrik Uhlbach & Pierre-Alexandre Balland & Thomas Scherngell, 2017. "R&D Policy and Technological Trajectories of Regions: Evidence from the EU Framework Programmes," Papers in Evolutionary Economic Geography (PEEG) 1722, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Sep 2017.

    More about this item

    Keywords

    relatedness; unrelatedness; technological breakthroughs; regional diversification; European regions;
    All these keywords.

    JEL classification:

    • O18 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Urban, Rural, Regional, and Transportation Analysis; Housing; Infrastructure
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O33 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Technological Change: Choices and Consequences; Diffusion Processes
    • R11 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - General Regional Economics - - - Regional Economic Activity: Growth, Development, Environmental Issues, and Changes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:egu:wpaper:2118. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/deguunl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.