Does the use of open, non-anonymous peer review in scholarly publishing introduce bias? Evidence from the F1000Research post-publication open peer review publishing model

被引:22
作者
Thelwall, Mike [1 ]
Allen, Liz [2 ]
Papas, Eleanor-Rose [3 ]
Nyakoojo, Zena [2 ]
Weigert, Verena [4 ]
机构
[1] Univ Wolverhampton, Stat Cybermetr Res Grp, Wulfruna St, Wolverhampton WV1 1LY, W Midlands, England
[2] F1000 Res Ltd, London, England
[3] F1000 Res Ltd, Editorial Dept, London, England
[4] Jisc, Bristol, Avon, England
关键词
Open peer review; open science; peer review;
D O I
10.1177/0165551520938678
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As part of moves towards open knowledge practices, making peer review open is cited as a way to enable fuller scrutiny and transparency of assessments around research. There are now many flavours of open peer review in use across scholarly publishing, including where reviews arefully attributable and the reviewer is named.This study examines whether there is any evidence of bias in two areas of common critique of open, non-anonymous (named) peer review - and used in the post-publication, peer review system operated by the open-access scholarly publishing platform F1000Research.First, is there evidence of potential bias where a reviewer based in a specific country assesses the work of an author also based in the same country?Second, are reviewers influenced by being able to see the comments and know the origins of a previous reviewer? Based on over 4 years of open peer review data, we found some weak evidence that being based in the same country as an author may influence a reviewer's decision, while there was insufficient evidence to conclude that being able to read an existing published reviewpriorto submitting a review encourages conformity. Thus, while immediate publishing of peer review reports appears to be unproblematic, caution may be needed when selecting same-country reviewers in open systems if other studies confirm these results.
引用
收藏
页码:809 / 820
页数:12
相关论文
共 32 条
  • [1] Barros T, 2017, F1000RESEARCH, V6, DOI [10.7490/f1000research.1114870.1, DOI 10.7490/F1000RESEARCH.1114870.1]
  • [2] CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING
    BENJAMINI, Y
    HOCHBERG, Y
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) : 289 - 300
  • [3] Acceptance rates of scholarly peer-reviewed journals: A literature survey
    Bjork, Bo-Christer
    [J]. PROFESIONAL DE LA INFORMACION, 2019, 28 (04):
  • [4] Beyond authorship: attribution, contribution, collaboration, and credit
    Brand, Amy
    Allen, Liz
    Altman, Micah
    Hlava, Marjorie
    Scott, Jo
    [J]. LEARNED PUBLISHING, 2015, 28 (02) : 151 - 155
  • [5] The effect of publishing peer review reports on referee behavior in five scholarly journals
    Bravo, Giangiacomo
    Grimaldo, Francisco
    Lopez-Inesta, Emilia
    Mehmani, Bahar
    Squazzoni, Flaminio
    [J]. NATURE COMMUNICATIONS, 2019, 10 (1)
  • [6] Understanding current causes of women's underrepresentation in science
    Ceci, Stephen J.
    Williams, Wendy M.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (08) : 3157 - 3162
  • [7] Editor and reviewer gender influence the peer review process but not peer review outcomes at an ecology journal
    Fox, Charles W.
    Burns, C. Sean
    Meyer, Jennifer A.
    [J]. FUNCTIONAL ECOLOGY, 2016, 30 (01) : 140 - 153
  • [8] Does a research article's country of origin affect perception of its quality and relevance? A national trial of US public health researchers
    Harris, M.
    Macinko, J.
    Jimenez, G.
    Mahfoud, M.
    Anderson, C.
    [J]. BMJ OPEN, 2015, 5 (12):
  • [9] Effects of editorial peer review - A systematic review
    Jefferson, T
    Alderson, P
    Wager, E
    Davidoff, F
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2002, 287 (21): : 2784 - 2786
  • [10] Kirkham J, 2018, F1000RESEARCH