Evaluation for the allocation of university research project funding: Can rules improve the peer review?

被引:19
作者
Reale, Emanuela [1 ]
Zinilli, Antonio [1 ]
机构
[1] CNR, IRCRES, Res Inst Sustainable Econ Growth, Via Taurini 19, I-00185 Rome, Italy
关键词
peer review; project funding; evaluation; university funding; BIAS;
D O I
10.1093/reseval/rvx019
中图分类号
G25 [图书馆学、图书馆事业]; G35 [情报学、情报工作];
学科分类号
1205 ; 120501 ;
摘要
Evaluation for the allocation of project-funding schemes devoted to sustain academic research often undergoes changes of the rules for the ex-ante selection, which are supposed to improve the capability of peer review to select the best proposals. How modifications of the rules realize a more accountable evaluation result? Do the changes suggest an improved alignment with the program's intended objectives? The article addresses these questions investigating Research Project of National Interest, an Italian collaborative project-funding scheme for academic curiosity-driven research through a case study design that provides a description of how the changes of the ex-ante evaluation process were implemented in practice. The results show that when government tries to steer the peer-review process by imposing an increasing number of rules to structure the debate among peers and make it more accountable, the peer-review practices remain largely impervious to the change.
引用
收藏
页码:190 / 198
页数:9
相关论文
共 25 条
  • [11] The policy challenges of peer review: managing bias, conflict of interests and interdisciplinary assessments
    Langfeldt, Liv
    [J]. RESEARCH EVALUATION, 2006, 15 (01) : 31 - 41
  • [12] Researchers as evaluators: tasks, tensions and politics
    Langfeldt, Liv
    Kyvik, Svein
    [J]. HIGHER EDUCATION, 2011, 62 (02) : 199 - 212
  • [14] Bias in peer review
    Lee, Carole J.
    Sugimoto, Cassidy R.
    Zhang, Guo
    Cronin, Blaise
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2013, 64 (01): : 2 - 17
  • [15] Lepori B.e., 2007, Science and Public Policy, V34, P372, DOI [10.3152/030234207X234578, DOI 10.3152/030234207X234578, https://doi.org/10.3152/030234207X234578]
  • [16] Improving the peer-review process for grant applications - Reliability, validity, bias, and generalizability
    Marsh, Herbert W.
    Jayasinghe, Upali W.
    Bond, Nigel W.
    [J]. AMERICAN PSYCHOLOGIST, 2008, 63 (03) : 160 - 168
  • [17] MATTHEW EFFECT IN SCIENCE
    MERTON, RK
    [J]. SCIENCE, 1968, 159 (3810) : 56 - &
  • [18] Neave Guy., 1991, Prometheus Bound: the changing relationship between government and higher education in Western Europe
  • [19] Power laws, Pareto distributions and Zipf's law
    Newman, MEJ
    [J]. CONTEMPORARY PHYSICS, 2005, 46 (05) : 323 - 351
  • [20] Seeber M., 2011, STUDIES HIGHER ED, V38, P20