A harm reduction approach to improving peer review by acknowledging its imperfections

被引:0
作者
Cooke, Steven J. [1 ,2 ]
Young, Nathan [3 ]
Peiman, Kathryn S. [1 ,2 ]
Roche, Dominique G. [1 ,2 ]
Clements, Jeff C. [4 ]
Kadykalo, Andrew N. [1 ,2 ,5 ]
Provencher, Jennifer F. [1 ,2 ,6 ]
Raghavan, Rajeev [7 ]
DeRosa, Maria C. [8 ]
Lennox, Robert J. [9 ]
Fayek, Aminah Robinson [10 ]
Cristescu, Melania E. [11 ]
Murray, Stuart J. [12 ]
Quinn, Joanna [13 ,14 ]
Cobey, Kelly D. [15 ,16 ]
Browman, Howard I. [17 ]
机构
[1] Carleton Univ, Canadian Ctr Evidence Based Conservat, Dept Biol, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[2] Carleton Univ, Inst Environm & Interdisciplinary Sci, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[3] Univ Ottawa, Sch Sociol & Anthropol Studies, 120 Univ Private, Ottawa, ON K1N 6N5, Canada
[4] Fisheries & Oceans Canada Gulf Reg, 343 Univ Ave, Moncton, NB E1C 9B6, Canada
[5] McGill Univ, Dept Nat Resource Sci, Macdonald Stewart Bldg, 21111 Lakeshore Rd, Ste Anne De Bellevue, PQ H9X 3V9, Canada
[6] Environm & Climate Change Canada, Natl Wildlife Res Ctr, Ecotoxicol & Wildlife Hlth Div, Sci & Technol Branch, 1125 Colonel Dr,Raven Rd, Ottawa, ON K1S 5B6, Canada
[7] Kerala Univ Fisheries & Ocean Studies KUFOS, Dept Fisheries Resource Management, Kochi, India
[8] Carleton Univ, Inst Biochem, Dept Chem, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[9] Dalhousie Univ, Dept Biol, Ocean Tracking Network, 1355 Oxford St, Halifax, NS B3H 4R2, Canada
[10] Univ Alberta, Dept Civil & Environm Engn, 7-226 Donadeo Innovat Ctr Engn, Edmonton, AB T6G 1H9, Canada
[11] McGill Univ, Dept Biol, 1205 Docteur Penfield, Montreal, PQ H3A 1B1, Canada
[12] Carleton Univ, Dept English Language & Literature, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[13] Western Univ, Ctr Transit Justice & Postconflict Reconstruct, Dept Polit Sci, London, ON, Canada
[14] Western Univ, Fac Law, London, ON N6A 5C2, Canada
[15] Univ Ottawa, Heart Inst, Ottawa, ON K1Y 4W7, Canada
[16] Univ Ottawa, Sch Epidemiol & Publ Hlth, Ottawa, ON K1Y 4W7, Canada
[17] Inst Marine Res, Acoust & Observat Methodol Res Grp, Sauganeset 16, N-5392 Storebo, Norway
来源
FACETS | 2024年 / 9卷
基金
加拿大自然科学与工程研究理事会;
关键词
anonymity; bias; ethics; flaw; open review; quality; DOUBLE-BLIND; PREDATORY JOURNALS; MANAGING TRUST; POST-TRUTH; SCIENCE; QUALITY; ECOLOGY; PUBLICATIONS; UNCERTAINTY; SCIENTISTS;
D O I
暂无
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This candid perspective written by scholars from diverse disciplinary backgrounds is intended to advance conversations about the realities of peer review and its inherent limitations. Trust in a process or institution is built slowly and can be destroyed quickly. Trust in the peer review process for scholarly outputs (i.e., journal articles) is being eroded by high-profile scandals, exaggerated news stories, expos & eacute;s, corrections, retractions, and anecdotes about poor practices. Diminished trust in the peer review process has real-world consequences and threatens the uptake of critical scientific advances. The literature on "crises of trust" tells us that rebuilding diminished trust takes time and requires frank admission and discussion of problems, creative thinking that addresses rather than dismisses criticisms, and planning and enacting short- and long-term reforms to address the root causes of problems. This article takes steps in this direction by presenting eight peer review reality checks and summarizing efforts to address their weaknesses using a harm reduction approach, though we recognize that reforms take time and some problems may never be fully rectified. While some forms of harm reduction will require structural and procedural changes, we emphasize the vital role that training editors, reviewers, and authors has in harm reduction. Additionally, consumers of science need training about how the peer review process works and how to critically evaluate research findings. No amount of self-policing, transparency, or reform to peer review will eliminate all bad actors, unscrupulous publishers, perverse incentives that reward cutting corners, intentional deception, or bias. However, the scientific community can act to minimize the harms from these activities, while simultaneously (re)building the peer review process. A peer review system is needed, even if it is imperfect.
引用
收藏
页数:14
相关论文
共 225 条
  • [1] Estimating the reproducibility of psychological science
    Aarts, Alexander A.
    Anderson, Joanna E.
    Anderson, Christopher J.
    Attridge, Peter R.
    Attwood, Angela
    Axt, Jordan
    Babel, Molly
    Bahnik, Stepan
    Baranski, Erica
    Barnett-Cowan, Michael
    Bartmess, Elizabeth
    Beer, Jennifer
    Bell, Raoul
    Bentley, Heather
    Beyan, Leah
    Binion, Grace
    Borsboom, Denny
    Bosch, Annick
    Bosco, Frank A.
    Bowman, Sara D.
    Brandt, Mark J.
    Braswell, Erin
    Brohmer, Hilmar
    Brown, Benjamin T.
    Brown, Kristina
    Bruening, Jovita
    Calhoun-Sauls, Ann
    Callahan, Shannon P.
    Chagnon, Elizabeth
    Chandler, Jesse
    Chartier, Christopher R.
    Cheung, Felix
    Christopherson, Cody D.
    Cillessen, Linda
    Clay, Russ
    Cleary, Hayley
    Cloud, Mark D.
    Cohn, Michael
    Cohoon, Johanna
    Columbus, Simon
    Cordes, Andreas
    Costantini, Giulio
    Alvarez, Leslie D. Cramblet
    Cremata, Ed
    Crusius, Jan
    DeCoster, Jamie
    DeGaetano, Michelle A.
    Della Penna, Nicolas
    den Bezemer, Bobby
    Deserno, Marie K.
    [J]. SCIENCE, 2015, 349 (6251)
  • [2] A billion-dollar donation: estimating the cost of researchers' time spent on peer review
    Aczel, Balazs
    Szaszi, Barnabas
    Holcombe, Alex O.
    [J]. RESEARCH INTEGRITY AND PEER REVIEW, 2021, 6 (01)
  • [3] Building trust in journals and in peer review: need of the hour during the COVID-19 pandemic
    Ahmed, Sakir
    Mohini
    [J]. RHEUMATOLOGY INTERNATIONAL, 2021, 41 (02) : 501 - 502
  • [4] Evaluating prospective study registration and result reporting of trials conducted in Canada from 2009 to 2019
    Alayche, Mohsen
    Cobey, Kelly D.
    Ng, Jeremy Y.
    Ardern, Clare L.
    Khan, Karim M.
    Chan, An-Wen
    Chow, Ryan
    Masalkhi, Mouayad
    Ayala, Ana Patricia
    Ebrahimzadeh, Sanam
    Ghossein, Jason
    Alayche, Ibrahim
    Willis, Jessie, V
    Moher, David
    [J]. FACETS, 2023, 8 : 1 - 10
  • [5] Is it becoming harder to secure reviewers for peer review? A test with data from five ecology journals
    Arianne Y. K. Albert
    Jennifer L. Gow
    Alison Cobra
    Timothy H. Vines
    [J]. Research Integrity and Peer Review, 1 (1)
  • [6] No harm in being self-corrective: Self-criticism and reform intentions increase researchers' epistemic trustworthiness and credibility in the eyes of the public
    Altenmuller, Marlene Sophie
    Nuding, Stephan
    Gollwitzer, Mario
    [J]. PUBLIC UNDERSTANDING OF SCIENCE, 2021, 30 (08) : 962 - 976
  • [7] [Anonymous], 2018, Tri-council policy statement ethical conduct for research involving humans TCPS2 2018
  • [8] [Anonymous], 2011, Code of Conduct and Best Practice Guidelines for Journal Editors
  • [9] Bailin S., 2002, Science & Education, V11, P361, DOI [10.1023/a:1016042608621, DOI 10.1023/A:1016042608621]
  • [10] Baker M, 2016, NATURE, V540, P151, DOI 10.1038/540151a