No raw data, no science: another possible source of the reproducibility crisis

被引:140
作者
Miyakawa, Tsuyoshi [1 ]
机构
[1] Fujita Hlth Univ, Inst Comprehens Med Sci, Div Syst Med Sci, Toyoake, Aichi 4701192, Japan
关键词
Raw data; Data fabrication; Open data; Open science; Misconduct; Reproducibility;
D O I
10.1186/s13041-020-0552-2
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
A reproducibility crisis is a situation where many scientific studies cannot be reproduced. Inappropriate practices of science, such as HARKing, p-hacking, and selective reporting of positive results, have been suggested as causes of irreproducibility. In this editorial, I propose that a lack of raw data or data fabrication is another possible cause of irreproducibility. As an Editor-in-Chief of Molecular Brain, I have handled 180 manuscripts since early 2017 and have made 41 editorial decisions categorized as "Revise before review," requesting that the authors provide raw data. Surprisingly, among those 41 manuscripts, 21 were withdrawn without providing raw data, indicating that requiring raw data drove away more than half of the manuscripts. I rejected 19 out of the remaining 20 manuscripts because of insufficient raw data. Thus, more than 97% of the 41 manuscripts did not present the raw data supporting their results when requested by an editor, suggesting a possibility that the raw data did not exist from the beginning, at least in some portions of these cases. Considering that any scientific study should be based on raw data, and that data storage space should no longer be a challenge, journals, in principle, should try to have their authors publicize raw data in a public database or journal site upon the publication of the paper to increase reproducibility of the published results and to increase public trust in science.
引用
收藏
页数:6
相关论文
共 15 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]   Recommendations for Increasing Replicability in Psychology [J].
Asendorpf, Jens B. ;
Conner, Mark ;
De Fruyt, Filip ;
De Houwer, Jan ;
Denissen, Jaap J. A. ;
Fiedler, Klaus ;
Fiedler, Susann ;
Funder, David C. ;
Kliegl, Reinhold ;
Nosek, Brian A. ;
Perugini, Marco ;
Roberts, Brent W. ;
Schmitt, Manfred ;
vanAken, Marcel A. G. ;
Weber, Hannelore ;
Wicherts, Jelte M. .
EUROPEAN JOURNAL OF PERSONALITY, 2013, 27 (02) :108-119
[3]  
Baker M, 2016, NATURE, V533, P452, DOI 10.1038/533452a
[4]   Reproducibility in Science Improving the Standard for Basic and Preclinical Research [J].
Begley, C. Glenn ;
Ioannidis, John P. A. .
CIRCULATION RESEARCH, 2015, 116 (01) :116-126
[5]   Raise standards for preclinical cancer research [J].
Begley, C. Glenn ;
Ellis, Lee M. .
NATURE, 2012, 483 (7391) :531-533
[6]   The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications [J].
Bik, Elisabeth M. ;
Casadevall, Arturo ;
Fang, Ferric C. .
MBIO, 2016, 7 (03)
[7]   Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias [J].
Dwan, Kerry ;
Altman, Douglas G. ;
Arnaiz, Juan A. ;
Bloom, Jill ;
Chan, An-Wen ;
Cronin, Eugenia ;
Decullier, Evelyne ;
Easterbrook, Philippa J. ;
Von Elm, Erik ;
Gamble, Carrol ;
Ghersi, Davina ;
Ioannidis, John P. A. ;
Simes, John ;
Williamson, Paula R. .
PLOS ONE, 2008, 3 (08)
[8]   How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data [J].
Fanelli, Daniele .
PLOS ONE, 2009, 4 (05)
[9]   Retracted Science and the Retraction Index [J].
Fang, Ferric C. ;
Casadevall, Arturo .
INFECTION AND IMMUNITY, 2011, 79 (10) :3855-3859
[10]   The Extent and Consequences of P-Hacking in Science [J].
Head, Megan L. ;
Holman, Luke ;
Lanfear, Rob ;
Kahn, Andrew T. ;
Jennions, Michael D. .
PLOS BIOLOGY, 2015, 13 (03)