Modeling peer review: an agent-based approach

被引:26
作者
Allesina, Stefano [1 ,2 ]
机构
[1] Univ Chicago, Dept Ecol, 1101 E 57th St, Chicago, IL 60637 USA
[2] Univ Chicago, Evolut & Computat Inst, Chicago, IL 60637 USA
来源
IDEAS IN ECOLOGY AND EVOLUTION | 2012年 / 5卷 / 02期
基金
美国国家科学基金会;
关键词
Peer-review; agent-based modeling; publishing; editorial rejection; simulations;
D O I
10.4033/iee.2012.5b.8.f
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The peer review system is under severe strain. Corrections have been proposed, but experiments to determine effective measures are difficult to perform. I propose a framework in which alternatives to the current peer review system can be studied quantitatively using agent-based modeling. I implement three possible systems. I show how, all other things being equal, these alternatives produce different results in terms of speed of publication, quality control, reviewers' effort and authors' impact. This modeling framework can be used to test other solutions for peer review, leading the way to an improvement of how science is disseminated.
引用
收藏
页码:27 / 35
页数:9
相关论文
共 23 条
[1]  
Aarssen LW., 2008, OPEN ECOL J, V1, P14, DOI DOI 10.2174/1874213000801010014
[2]  
Bentley P. J., 2009, P 11 ANN C COMP GEN, P2597
[3]   The effectiveness of the peer review process:: Inter-referee agreement and predictive validity of manuscript refereeing at Angewandte chemie [J].
Bornmann, Lutz ;
Daniel, Hans-Dieter .
ANGEWANDTE CHEMIE-INTERNATIONAL EDITION, 2008, 47 (38) :7173-7178
[4]   Selecting manuscripts for a high-impact journal through peer review:: A citation analysis of communications that were accepted by Angewandte Chemie International Edition, or rejected but published elsewhere [J].
Bornmann, Lutz ;
Daniel, Hans-Dieter .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2008, 59 (11) :1841-1852
[5]   Potential sources of bias in research fellowship assessments: effects of university prestige and field of study [J].
Bornmann, Lutz ;
Daniel, Hans-Dieter .
RESEARCH EVALUATION, 2006, 15 (03) :209-219
[6]   Come the revolution [J].
Buchanan, Mark .
NATURE PHYSICS, 2010, 6 (01) :2-2
[7]  
CAMPANARIO J, 1997, THE SCIENTIST, V11, P9
[8]   Improving peer review with CARMA [J].
Carmi, Ran ;
Koch, Christof .
LEARNED PUBLISHING, 2007, 20 (03) :173-176
[9]   Confidential reports may improve peer review [J].
Cintas, P .
NATURE, 2004, 428 (6980) :255-255
[10]   An incentive solution to the peer review problem [J].
Hauser, Marc ;
Fehr, Ernst .
PLOS BIOLOGY, 2007, 5 (04) :703-703