Is the future of peer review automated?

被引:40
作者
Schulz, Robert [1 ]
Barnett, Adrian [2 ,3 ]
Bernard, Rene [4 ]
Brown, Nicholas J. L. [5 ]
Byrne, Jennifer A. [6 ]
Eckmann, Peter [7 ]
Gazda, Malgorzata A. [8 ]
Kilicoglu, Halil [9 ]
Prager, Eric M. [10 ]
Salholz-Hillel, Maia
ter Riet, Gerben [11 ]
Vines, Timothy [12 ]
Vorland, Colby J. [13 ]
Zhuang, Han [14 ]
Bandrowski, Anita [7 ]
Weissgerber, Tracey L. [1 ]
机构
[1] Charite Univ Med Berlin, Berlin Inst Hlth, BIH QUEST Ctr Responsible Res, Berlin, Germany
[2] Queensland Univ Technol, Australian Ctr Hlth Serv Innovat, Brisbane, Qld, Australia
[3] Queensland Univ Technol, Ctr Healthcare Transformat, Sch Publ Hlth & Social Work, Brisbane, Qld, Australia
[4] Charite Univ Med Berlin, NeuroCure Cluster Excellence, Berlin, Germany
[5] Linnaeus Univ, Dept Psychol, Vaxjo, Sweden
[6] Univ Sydney, New South Wales Hlth Pathol, Fac Med & Hlth, Sydney, NSW, Australia
[7] Univ Calif San Diego, Dept Neurosci, La Jolla, CA 92093 USA
[8] Univ Paris, Inst Pasteur, UMR 3525, Comparat Functional Genom Grp,INSERM UA12,CNRS, Paris, France
[9] Univ Illinois, Sch Informat Sci, Champaign, IL USA
[10] Cohen Vet Biosci, Translat Res & Dev, New York, NY USA
[11] Amsterdam Univ Appl Sci, Fac Hlth, Ctr Expertise Urban Vital, Amsterdam, Netherlands
[12] DataSeer Res Data Serv Ltd, Vancouver, BC, Canada
[13] Indiana Univ, Sch Publ Hlth Bloomington, Bloomington, IN USA
[14] Syracuse Univ, Sch Informat Studies, Syracuse, NY USA
基金
英国医学研究理事会;
关键词
Rigor; Reproducibility; Transparency; Automated screening; Peer review; GUIDELINES;
D O I
10.1186/s13104-022-06080-6
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The rising rate of preprints and publications, combined with persistent inadequate reporting practices and problems with study design and execution, have strained the traditional peer review system. Automated screening tools could potentially enhance peer review by helping authors, journal editors, and reviewers to identify beneficial practices and common problems in preprints or submitted manuscripts. Tools can screen many papers quickly, and may be particularly helpful in assessing compliance with journal policies and with straightforward items in reporting guidelines. However, existing tools cannot understand or interpret the paper in the context of the scientific literature. Tools cannot yet determine whether the methods used are suitable to answer the research question, or whether the data support the authors' conclusions. Editors and peer reviewers are essential for assessing journal fit and the overall quality of a paper, including the experimental design, the soundness of the study's conclusions, potential impact and innovation. Automated screening tools cannot replace peer review, but may aid authors, reviewers, and editors in improving scientific papers. Strategies for responsible use of automated tools in peer review may include setting performance criteria for tools, transparently reporting tool performance and use, and training users to interpret reports.
引用
收藏
页数:5
相关论文
共 36 条
[1]   Tracking the popularity and outcomes of all bioRxiv preprints [J].
Abdill, Richard J. ;
Blekhman, Ran .
ELIFE, 2019, 8
[2]   Reporting ethical approval in health and social science articles: an audit of adherence to GDPR and national legislation [J].
Asplund, Kjell ;
Asberg, Kerstin Hulter .
BMC MEDICAL ETHICS, 2021, 22 (01)
[3]   Correction of scientific literature: Too little, too late! [J].
Besançom, Lonni ;
Bik, Elisabeth ;
Heathers, James ;
Meyerowitz-Katz, Gideon .
PLOS BIOLOGY, 2022, 20 (03)
[4]   Scoping review on interventions to improve adherence to reporting guidelines in health research [J].
Blanco, David ;
Altman, Doug ;
Moher, David ;
Boutron, Isabelle ;
Kirkham, Jamie J. ;
Cobo, Erik .
BMJ OPEN, 2019, 9 (05)
[5]   The GRIM Test: A Simple Technique Detects Numerous Anomalies in the Reporting of Results in Psychology [J].
Brown, Nicholas J. L. ;
Heathers, James A. J. .
SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE, 2017, 8 (04) :363-369
[6]   Top ten errors of statistical analysis in observational studies for cancer research [J].
Carmona-Bayonas, A. ;
Jimenez-Fonseca, P. ;
Fernandez-Somoano, A. ;
Alvarez-Mancenido, F. ;
Castanon, E. ;
Custodio, A. ;
de la Pena, F. A. ;
Payo, R. M. ;
Valiente, L. P. .
CLINICAL & TRANSLATIONAL ONCOLOGY, 2018, 20 (08) :954-965
[7]   Evolution of poor reporting and inadequate methods over time in 20 920 randomised controlled trials included in Cochrane reviews: research on research study [J].
Dechartres, Agnes ;
Trinquart, Ludovic ;
Atal, Ignacio ;
Moher, David ;
Dickersin, Kay ;
Boutron, Isabelle ;
Perrodeau, Elodie ;
Altman, Douglas G. ;
Ravaud, Philippe .
BMJ-BRITISH MEDICAL JOURNAL, 2017, 357
[8]   Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 [J].
du Sert, Nathalie Percie ;
Ahluwalia, Amrita ;
Alam, Sabina ;
Avey, Marc T. ;
Baker, Monya ;
Browne, William J. ;
Clark, Alejandra ;
Cuthill, Innes C. ;
Dirnagl, Ulrich ;
Emerson, Michael ;
Garner, Paul ;
Holgate, Stephen T. ;
Howells, David W. ;
Hurst, Viki ;
Karp, Natasha A. ;
Lazic, Stanley E. ;
Lidster, Katie ;
MacCallum, Catriona J. ;
Macleod, Malcolm ;
Pearl, Esther J. ;
Petersen, Ole H. ;
Rawle, Frances ;
Reynolds, Penny ;
Rooney, Kieron ;
Sena, Emily S. ;
Silberberg, Shai D. ;
Steckler, Thomas ;
Wuerbel, Hanno .
PLOS BIOLOGY, 2020, 18 (07)
[9]  
eLife, 2019, JETFIGHTER FIGURE AC
[10]   A randomised controlled trial of an Intervention to Improve Compliance with the ARRIVE guidelines (IICARus) [J].
Hair, Kaitlyn ;
Macleod, Malcolm R. ;
Sena, Emily S. .
RESEARCH INTEGRITY AND PEER REVIEW, 2019, 4 (01)