A harm reduction approach to improving peer review by acknowledging its imperfections

被引:0
作者
Cooke, Steven J. [1 ,2 ]
Young, Nathan [3 ]
Peiman, Kathryn S. [1 ,2 ]
Roche, Dominique G. [1 ,2 ]
Clements, Jeff C. [4 ]
Kadykalo, Andrew N. [1 ,2 ,5 ]
Provencher, Jennifer F. [1 ,2 ,6 ]
Raghavan, Rajeev [7 ]
DeRosa, Maria C. [8 ]
Lennox, Robert J. [9 ]
Fayek, Aminah Robinson [10 ]
Cristescu, Melania E. [11 ]
Murray, Stuart J. [12 ]
Quinn, Joanna [13 ,14 ]
Cobey, Kelly D. [15 ,16 ]
Browman, Howard I. [17 ]
机构
[1] Carleton Univ, Canadian Ctr Evidence Based Conservat, Dept Biol, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[2] Carleton Univ, Inst Environm & Interdisciplinary Sci, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[3] Univ Ottawa, Sch Sociol & Anthropol Studies, 120 Univ Private, Ottawa, ON K1N 6N5, Canada
[4] Fisheries & Oceans Canada Gulf Reg, 343 Univ Ave, Moncton, NB E1C 9B6, Canada
[5] McGill Univ, Dept Nat Resource Sci, Macdonald Stewart Bldg, 21111 Lakeshore Rd, Ste Anne De Bellevue, PQ H9X 3V9, Canada
[6] Environm & Climate Change Canada, Natl Wildlife Res Ctr, Ecotoxicol & Wildlife Hlth Div, Sci & Technol Branch, 1125 Colonel Dr,Raven Rd, Ottawa, ON K1S 5B6, Canada
[7] Kerala Univ Fisheries & Ocean Studies KUFOS, Dept Fisheries Resource Management, Kochi, India
[8] Carleton Univ, Inst Biochem, Dept Chem, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[9] Dalhousie Univ, Dept Biol, Ocean Tracking Network, 1355 Oxford St, Halifax, NS B3H 4R2, Canada
[10] Univ Alberta, Dept Civil & Environm Engn, 7-226 Donadeo Innovat Ctr Engn, Edmonton, AB T6G 1H9, Canada
[11] McGill Univ, Dept Biol, 1205 Docteur Penfield, Montreal, PQ H3A 1B1, Canada
[12] Carleton Univ, Dept English Language & Literature, 1125 Colonel Dr, Ottawa, ON K1S 5B6, Canada
[13] Western Univ, Ctr Transit Justice & Postconflict Reconstruct, Dept Polit Sci, London, ON, Canada
[14] Western Univ, Fac Law, London, ON N6A 5C2, Canada
[15] Univ Ottawa, Heart Inst, Ottawa, ON K1Y 4W7, Canada
[16] Univ Ottawa, Sch Epidemiol & Publ Hlth, Ottawa, ON K1Y 4W7, Canada
[17] Inst Marine Res, Acoust & Observat Methodol Res Grp, Sauganeset 16, N-5392 Storebo, Norway
来源
FACETS | 2024年 / 9卷
基金
加拿大自然科学与工程研究理事会;
关键词
anonymity; bias; ethics; flaw; open review; quality; DOUBLE-BLIND; PREDATORY JOURNALS; MANAGING TRUST; POST-TRUTH; SCIENCE; QUALITY; ECOLOGY; PUBLICATIONS; UNCERTAINTY; SCIENTISTS;
D O I
暂无
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This candid perspective written by scholars from diverse disciplinary backgrounds is intended to advance conversations about the realities of peer review and its inherent limitations. Trust in a process or institution is built slowly and can be destroyed quickly. Trust in the peer review process for scholarly outputs (i.e., journal articles) is being eroded by high-profile scandals, exaggerated news stories, expos & eacute;s, corrections, retractions, and anecdotes about poor practices. Diminished trust in the peer review process has real-world consequences and threatens the uptake of critical scientific advances. The literature on "crises of trust" tells us that rebuilding diminished trust takes time and requires frank admission and discussion of problems, creative thinking that addresses rather than dismisses criticisms, and planning and enacting short- and long-term reforms to address the root causes of problems. This article takes steps in this direction by presenting eight peer review reality checks and summarizing efforts to address their weaknesses using a harm reduction approach, though we recognize that reforms take time and some problems may never be fully rectified. While some forms of harm reduction will require structural and procedural changes, we emphasize the vital role that training editors, reviewers, and authors has in harm reduction. Additionally, consumers of science need training about how the peer review process works and how to critically evaluate research findings. No amount of self-policing, transparency, or reform to peer review will eliminate all bad actors, unscrupulous publishers, perverse incentives that reward cutting corners, intentional deception, or bias. However, the scientific community can act to minimize the harms from these activities, while simultaneously (re)building the peer review process. A peer review system is needed, even if it is imperfect.
引用
收藏
页数:14
相关论文
共 225 条
  • [51] Inclusion of predatory journals in Scopus is inflating scholars' metrics and advancing careers
    Cortegiani, Andrea
    Manca, Andrea
    Lalu, Manoj
    Moher, David
    [J]. INTERNATIONAL JOURNAL OF PUBLIC HEALTH, 2020, 65 (01) : 3 - 4
  • [52] Low availability of code in ecology: A call for urgent action
    Culina, Antica
    van den Berg, Ilona
    Evans, Simon
    Sanchez-Tojar, Alfredo
    [J]. PLOS BIOLOGY, 2020, 18 (07)
  • [53] Strategies for building and managing 'trust' to enable knowledge exchange at the interface of environmental science and policy
    Cvitanovic, C.
    Shellock, R. J.
    Mackay, M.
    van Putten, E., I
    Karcher, D. B.
    Dickey-Collas, M.
    Ballesteros, M.
    [J]. ENVIRONMENTAL SCIENCE & POLICY, 2021, 123 : 179 - 189
  • [54] How to trust a scientist
    de Ridder, Jeroen
    [J]. STUDIES IN HISTORY AND PHILOSOPHY OF SCIENCE, 2022, 93 : 11 - 20
  • [55] Toward a Philosophy of Harm Reduction
    Dea, Shannon
    [J]. HEALTH CARE ANALYSIS, 2020, 28 (04) : 302 - 313
  • [56] Exploring the Peer Review Process: What Is It, Does It Work, and Can It Be Improved?
    DeVries, Dennis R.
    Marschall, Elizabeth A.
    Stein, Roy A.
    [J]. FISHERIES, 2009, 34 (06) : 270 - 279
  • [57] The new watchdogs' vision of science: A roundtable with Ivan Oransky (Retraction Watch) and Brandon Stell (PubPeer)
    Didier, Emmanuel
    Guaspare-Cartron, Catherine
    [J]. SOCIAL STUDIES OF SCIENCE, 2018, 48 (01) : 165 - 167
  • [58] Managing uncertainty in research and development
    Doctor, RN
    Newton, DP
    Pearson, A
    [J]. TECHNOVATION, 2001, 21 (02) : 79 - 90
  • [59] Donnelly CA, 2018, NATURE, V558, P361, DOI 10.1038/d41586-018-05414-4
  • [60] Durbin CG, 2009, RESP CARE, V54, P1366