Replication; independent replication; systematic review; impact; empirical research
Résumé :
[en] Replication studies are important for the empirical research process. Yet, while there is an increased awareness of the need for replication in management research, it appears that such studies are rarely published in leading management journals. Importantly, we lack a comprehensive overview of replication studies in the top management journals that spans all sub-disciplines. Our systematic review closes this gap and provides an overview of the prevalence, types, outcomes, and impact of replication studies in management journals. We find that differences in the prevalence of replications between sub-disciplines exist and that most replications are wide replications. With regard to the replication outcome, our review shows that the share of non-confirming replications is low. Moreover, such replications are cited less often than confirming replications pointing towards a confirmation bias in management research. We discuss the implications of our results for authors, reviewers, and editors of management journals.
Centre de recherche :
Interdisciplinary Centre for Security, Reliability and Trust (SnT) > EINT-Entrepreneurship, Innovation and New Technology
Disciplines :
Gestion de l’entreprise, entrepreneuriat & théorie des organisations
Auteur, co-auteur :
Block, Jörn
FISCH, Christian ; University of Luxembourg > Interdisciplinary Centre for Security, Reliability and Trust (SNT) > Entrepreneurship, Innovation, and New Technology (EINT)
Kanwal, Narmeen
Lorenzen, Solvej
Schulze, Anna
Co-auteurs externes :
yes
Langue du document :
Anglais
Titre :
Replication studies in top management journals: an empirical investigation of prevalence, types, outcomes, and impact
Date de publication/diffusion :
2023
Titre du périodique :
Management Review Quarterly: Systematic Literature Reviews, Meta-Analyses, and Replication Studies
ABS (2018) Academic journal guide by the Chartered Association of Business Schools. Available at: https://facultystaff.richmond.edu/~tmattson/AJG%202018%20Journal%20Guide.pdf. Last accessed: August 27, 2021
Aguinis H, Cascio WF, Ramani RS (2017) Science’s reproducibility and replicability crisis: International business is not immune. J Int Bus Stud 48:653–663 DOI: 10.1057/s41267-017-0081-0
Anderson SF, Maxwell SE (2016) There’s more than one way to conduct a replication study: Beyond statistical significance. Psychol Methods 21(1):1–12 DOI: 10.1037/met0000051
Arthur WB (1989) Competing technologies, increasing returns, and lock-in by historical events. Econ J 99(394):116–131 DOI: 10.2307/2234208
Bergh DD, Sharp BM, Aguinis H, Li M (2017) Is there a credibility crisis in strategic management research? Evidence on the reproducibility of study findings. Strategic Organ 15(3):423–436 DOI: 10.1177/1476127017701076
Bettis RA, Helfat CE, Shaver JM (2016) The necessity, logic, and forms of replication. Strateg Manag J 37(11):2193–2203 DOI: 10.1002/smj.2580
Block J, Kuckertz A (2018) Seven principles of effective replication studies: strengthening the evidence base of management research. Manage Rev Q 68(4):355–359 DOI: 10.1007/s11301-018-0149-3
Block J, Hansen C, Steinmetz H (in press) Are family firms doing more innovation output with less innovation input? A replication and extension. Entrepreneurship Theory and Practice
Camerer CF et al (2016) Evaluating replicability of laboratory experiments in economics. Science 351(6280):1433–1436 DOI: 10.1126/science.aaf0918
Camerer CF et al (2018) Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015. Nat Hum Behav 2(9):637–644 DOI: 10.1038/s41562-018-0399-z
Corley KG, Gioia DA (2011) Building theory about theory building: what constitutes a theoretical contribution? Acad Manage Rev 36(1):12–32 DOI: 10.5465/amr.2009.0486
De Massis A, Kellermanns F, Wright M, Brinkerink J (2020) Replication and validation in family business research. J Family Bus Strategy 11:100415 DOI: 10.1016/j.jfbs.2020.100415
Dettori A, Floris M (2022) Improving continuity by simplifying the structure of family firms: a replication study. Manage Rev Q 1–26. 10.1007/s11301-021-00255-4
Dau LA, Santangelo GD, van Witteloostuijn A (2021) Replication studies in international business.Journal of International Business Studies 1–16
Guest PM (2021) Risk Management in Financial Institutions: A Replication. The Journal of Finance, forthcoming
Harzing AW (2013) A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners. Scientometrics 94(3):1057–1075 DOI: 10.1007/s11192-012-0777-7
Hensel PG (2021) Reproducibility and replicability crisis: How management compares to psychology and economics e A systematic review of literature. Eur Manag J 39(5):577–594 DOI: 10.1016/j.emj.2021.01.002
Hubbard R, Vetter DE (1996) An empirical comparison of published replication research in accounting, economics, finance, management, and marketing. J Bus Res 35(2):153–164 DOI: 10.1016/0148-2963(95)00084-4
Hubbard R, Vetter DE, Little EL (1998) Replication in strategic management: scientific testing for validity, generalizability, and usefulness. Strateg Manag J 19(3):243–254 DOI: 10.1002/(SICI)1097-0266(199803)19:3<243::AID-SMJ951>3.0.CO;2-0
Köhler T, Cortina JM (2021) Play it again, Sam! An analysis of constructive replication in the organizational sciences. J Manag 47(2):488–518
Management Science (2021) Management Science policy for data and code disclosure. Available at: https://pubsonline.informs.org/page/mnsc/datapolicy#1. Last accessed: August 27, 2021
Maula M, Stam W (2020) Enhancing rigor in quantitative entrepreneurship research. Entrepreneurship Theory and Practice 44(6):1059–1090 DOI: 10.1177/1042258719891388
Maxwell SE, Lau MY, Howard GS (2015) Is psychology suffering from a replication crisis? What does “failure to replicate” really mean? Am Psychol 70(6):487–498 DOI: 10.1037/a0039400
Mueller-Langer F, Fecher B, Harhoff D, Wagner GG (2019) Replication studies in economics—How many and which papers are chosen for replication, and why? Res Policy 48(1):62–83 DOI: 10.1016/j.respol.2018.07.019
Open Science Collaboration (2015) Estimating the reproducibility of psychological science. Science 349(6251):aac4716 DOI: 10.1126/science.aac4716
Retraction Watch (2021) Top 10 most highly cited retracted papers. Available at: https://retractionwatch.com/the-retraction-watch-leaderboard/top-10-most-highly-cited-retracted-papers. Last accessed: August 27, 2021
Ryan JC, Tipu SA (2022) Business and management research: Low instances of replication studies and a lack of author independence in replications. Res Policy 51(1):104408 DOI: 10.1016/j.respol.2021.104408
Stroebe W, Strack F (2014) The alleged crisis and the illusion of exact replication. Perspect Psychol Sci 9(1):59–71 DOI: 10.1177/1745691613514450
Szumal JL, Boglarsky CA, Cooke RA (2021) Thinking and behavioral styles as described by self versus others: a replication and extension with male and female managers.Management Review Quarterly,1–30
Tsang EW, Kwan KM (1999) Replication and theory development in organizational science: a critical realist perspective. Acad Manage Rev 24(4):759–780 DOI: 10.2307/259353
Van Scotter JR (2020) Narcissism in CEO research: a review and replication of the archival approach. Manage Rev Q 70(4):629–674 DOI: 10.1007/s11301-019-00178-1
Yuan S, Rieger MO, Caliskan N (2020) Maxing out: the puzzling influence of past maximum returns on future asset prices in a cross-country analysis. Manage Rev Q 70(4):567–589 DOI: 10.1007/s11301-019-00176-3
Wright TA, Sweeney DA (2015) The call for an increased role of replication, extension, and mixed-methods study designs in organizational research. J Organizational Behav 37(3):480–486 DOI: 10.1002/job.2059
