Commensuration Bias in Peer Review

被引:50
|
作者
Lee, Carole J. [1 ]
机构
[1] Univ Washington, Dept Philosophy, Seattle, WA 98195 USA
基金
美国安德鲁·梅隆基金会;
关键词
PUBLICATION BIAS; REPLICATION RESEARCH; DECISION-MAKING; INCENTIVES; PROPOSAL; SCIENCE; TRIALS; TRUTH; NSF;
D O I
10.1086/683652
中图分类号
N09 [自然科学史]; B [哲学、宗教];
学科分类号
01 ; 0101 ; 010108 ; 060207 ; 060305 ; 0712 ;
摘要
To arrive at their final evaluation of a manuscript or grant proposal, reviewers must convert a submission's strengths and weaknesses for heterogeneous peer review criteria into a single metric of quality or merit. I identify this process of commensuration as the locus for a new kind of peer review bias. Commensuration bias illuminates how the systematic prioritization of some peer review criteria over others permits and facilitates problematic patterns of publication and funding in science. Commensuration bias also foregrounds a range of structural strategies for realigning peer review practices and institutions with the aims of science.
引用
收藏
页码:1272 / 1283
页数:12
相关论文
共 50 条
  • [1] Bias in peer review
    Lee, Carole J.
    Sugimoto, Cassidy R.
    Zhang, Guo
    Cronin, Blaise
    JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2013, 64 (01): : 2 - 17
  • [2] Research: Gender bias in scholarly peer review
    Helmer, Markus
    Schottdorf, Manuel
    Neef, Andreas
    Battaglia, Demian
    ELIFE, 2017, 6
  • [3] Impact of institutional affiliation bias in the peer review process
    Horchani, Ridha
    INSIGHTS-THE UKSG JOURNAL, 2025, 38
  • [4] Citation gamesmanship: testing for evidence of ego bias in peer review
    Sugimoto, Cassidy R.
    Cronin, Blaise
    SCIENTOMETRICS, 2013, 95 (03) : 851 - 862
  • [5] Reviewer bias in single-versus double-blind peer review
    Tomkins, Andrew
    Zhang, Min
    Heavlin, William D.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2017, 114 (48) : 12708 - 12713
  • [6] Is there gender bias in the peer-review process in several Elsevier's marine journals?
    Borja, Angel
    MARINE POLLUTION BULLETIN, 2015, 96 (1-2) : 1 - 2
  • [7] JCDL 2021 Tutorial on Systemic Challenges and Computational Solutions on Bias and Unfairness in Peer Review
    Shah, Nihar B.
    2021 ACM/IEEE JOINT CONFERENCE ON DIGITAL LIBRARIES (JCDL 2021), 2021, : 356 - 357
  • [8] Testing for the Presence of Positive-Outcome Bias in Peer Review A Randomized Controlled Trial
    Emerson, Gwendolyn B.
    Warme, Winston J.
    Wolf, Fredric M.
    Heckman, James D.
    Brand, Richard A.
    Leopold, Seth S.
    ARCHIVES OF INTERNAL MEDICINE, 2010, 170 (21) : 1934 - 1939
  • [9] WSDM 2021 Tutorial on Systemic Challenges and Computational Solutions on Bias and Unfairness in Peer Review
    Shah, Nihar B.
    WSDM '21: PROCEEDINGS OF THE 14TH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2021, : 1131 - 1133
  • [10] Metrics and methods in the evaluation of prestige bias in peer review: A case study in computer systems conferences
    Frachtenberg, Eitan
    McConville, Kelly S.
    PLOS ONE, 2022, 17 (02):