The State of Play of Reproducibility in Statistics: An Empirical Analysis.
Reproducibility, the ability to reproduce the results of published papers or studies using their computer code and data, is a cornerstone of reliable scientific methodology. Studies where results cannot be reproduced by the scientific community should be treated with caution. Over the past decade, t...
| Published in: | American Statistician Vol. 77; no. 2; pp. 115 - 127 |
|---|---|
| Main Authors: | , |
| Format: | Article |
| Published: |
Taylor & Francis Ltd
May2023
|
| Subjects: | |
| Online Access: | View this record in EBSCOhost |
| fields | @attributes: recordID: 1 pdfLink: plink: https://search.ebscohost.com/login.aspx?direct=true&db=ssf&AN=163317563&site=ehost-live header: @attributes: shortDbName: ssf uiTerm: 163317563 longDbName: Social Sciences Full Text (H.W. Wilson) uiTag: AN controlInfo: bkinfo: jinfo: jid: 00031305 STT jtl: American Statistician issn: 00031305 maglogo: Y pubinfo: dt: May2023 vid: 77 iid: 2 pid: 377 pub: Taylor & Francis Ltd artinfo: ui: 163317563 10.1080/00031305.2022.2131625 ppf: 115 ppct: 12 formats: tig: atl: The State of Play of Reproducibility in Statistics: An Empirical Analysis. aug: au: Xiong, Xin Cribben, Ivor affil: Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, MA Department of Accounting and Business Analytics, Alberta School of Business, University of Alberta, Edmonton, Canada su: Economist, The (Periodical) Functional magnetic resonance imaging Scientific method Computer programming Reproducible research Statistics sug: subj: Computer systems design and related services (except video game design and development) Custom Computer Programming Services Other Computer Related Services Functional magnetic resonance imaging Scientific method Computer programming Reproducible research Statistics Economist, The (Periodical) keyword: Computer code access Data access Open science Replicability Reproducibility Reproducibility policy Computer code access Data access Open science Replicability Reproducibility Reproducibility policy ab: Reproducibility, the ability to reproduce the results of published papers or studies using their computer code and data, is a cornerstone of reliable scientific methodology. Studies where results cannot be reproduced by the scientific community should be treated with caution. Over the past decade, the importance of reproducible research has been frequently stressed in a wide range of scientific journals such as Nature and Science and international magazines such as The Economist. However, multiple studies have demonstrated that scientific results are often not reproducible across research areas such as psychology and medicine. Statistics, the science concerned with developing and studying methods for collecting, analyzing, interpreting and presenting empirical data, prides itself on its openness when it comes to sharing both computer code and data. In this article, we examine reproducibility in the field of statistics by attempting to reproduce the results in 93 published papers in prominent journals using functional magnetic resonance imaging (fMRI) data during the 2010–2021 period. Overall, from both the computer code and the data perspective, among all the 93 examined papers, we could only reproduce the results in 14 (15.1%) papers, that is, the papers provide both executable computer code (or software) with the real fMRI data, and our results matched the results in the paper. Finally, we conclude with some author-specific and journal-specific recommendations to improve the research reproducibility in statistics. pubtype: Academic Journal doctype: Article src: R language: English refInfo: copyright: @attributes: flag: N holdings: @attributes: islocal: N |
|---|