OPENING THE BLACK-BOX OF REFEREE BEHAVIOUR. AN AGENT-BASED MODEL OF PEER REVIEW

被引:1
作者
Squazzoni, Flaminio [1 ]
Gandelli, Claudio [1 ]
机构
[1] Univ Brescia, Dept Social Sci, Via San Faustino 74-B, I-25122 Brescia, Italy
来源
PROCEEDINGS 26TH EUROPEAN CONFERENCE ON MODELLING AND SIMULATION ECMS 2012 | 2012年
关键词
Peer review; referees; referee behaviour; reciprocity; agent-based model;
D O I
10.7148/2012-0647-0653
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper investigates the impact of referee behaviour on the quality and efficiency of peer review. We focused especially on the importance of reciprocity motives to ensure cooperation between everyone involved. We modelled peer review as a process based on knowledge asymmetries and subject to evaluation bias. We built various simulation scenarios where we tested interaction conditions and manipulated author and referee behaviour. We found that reciprocity per se can have a negative effect on peer review as it tends to increase evaluation bias. It can have a positive impact only when purged by self-interest motivation and accompanied by disinterestedness and fairness standard.
引用
收藏
页码:647 / +
页数:2
相关论文
共 27 条
[1]   Reviewing peer review [J].
Alberts, Bruce ;
Hanson, Brooks ;
Kelner, Katrina L. .
SCIENCE, 2008, 321 (5885) :15-15
[2]   Evolution of social norms with heterogeneous preferences: A general model and an application to the academic review process [J].
Azar, Ofer H. .
JOURNAL OF ECONOMIC BEHAVIOR & ORGANIZATION, 2008, 65 (3-4) :420-435
[3]  
Björk BC, 2009, INFORM RES, V14
[4]   How to detect indications of potential sources of bias in peer review: A generalized latent variable modeling approach exemplified by a gender study [J].
Bornmann, Lutz ;
Mutz, Ruediger ;
Daniel, Hans-Dieter .
JOURNAL OF INFORMETRICS, 2008, 2 (04) :280-287
[5]   Convergent validation of peer review decisions using the h index -: Extent of and reasons for type I and type II errors [J].
Bornmann, Lutz ;
Daniel, Hans-Dieter .
JOURNAL OF INFORMETRICS, 2007, 1 (03) :204-213
[6]   Scientific Peer Review [J].
Bornmann, Lutz .
ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY, 2011, 45 :199-245
[7]  
Bowles S, 2011, COOPERATIVE SPECIES: HUMAN RECIPROCITY AND ITS EVOLUTION, P1
[8]   Peer review for journals as it stands today - Part 1 [J].
Campanario, JM .
SCIENCE COMMUNICATION, 1998, 19 (03) :181-211
[9]  
Casati F., 2009, DISI09045 U TRENT
[10]   Is it worthwhile to pay referees? [J].
Chang, JJ ;
Lai, CC .
SOUTHERN ECONOMIC JOURNAL, 2001, 68 (02) :457-463