Short-term incentives of research evaluations: Evidence from the UK Research Excellence Framework

被引:7
作者
Groen-Xu, Moqi [1 ]
Bos, Gregor [2 ]
Teixeira, Pedro A. [3 ]
Voigt, Thomas [4 ]
Knapp, Bernhard [5 ]
机构
[1] Queen Mary Univ London, Sch Econ & Finance, Mile End Rd, London E1 4NS, England
[2] Katholieke Univ Leuven, Inst Philosophy, Kardinaal Mercierpl 2 Bus 3200, B-3000 Leuven, Belgium
[3] Humboldt Univ, Ctr Marc Bloch, Friedrichstr 191, D-10117 Berlin, Germany
[4] UCL, Gower St, London WC1E 6BT, England
[5] UAS Tech Vienna, Hochstadtpl 6, A-1200 Vienna, Austria
基金
英国工程与自然科学研究理事会;
关键词
Research funding systems; Evaluation effects; Economics of science; Incentives; University; SOCIETAL IMPACT; PUBLICATION; PERFORMANCE; PERCEPTIONS; CITATIONS; JOURNALS; SCIENCE; SHARE; PAY;
D O I
10.1016/j.respol.2023.104729
中图分类号
C93 [管理学];
学科分类号
12 ; 1201 ; 1202 ; 120202 ;
摘要
We document incentive effects of the evaluation deadlines in the UK's performance-based research funding system. Studying 3,597,272 publications by UK researchers, we find that publications just before assessment deadlines obtain substantially fewer citations and are published in venues with lower impact factors. These trends reverse abruptly after the deadlines. We discuss different factors that contribute to this observation and provide evidence that evaluation deadlines are likely to set incentives against investment in research quality and long-term topics. We conclude that where such shifts in research incentives are not intended, they might require balancing by additional incentives for exploratory, long-term oriented research.
引用
收藏
页数:22
相关论文
共 89 条
[1]   Rescuing US biomedical research from its systemic flaws [J].
Alberts, Bruce ;
Kirschner, Marc W. ;
Tilghman, Shirley ;
Varmus, Harold .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2014, 111 (16) :5773-5777
[2]   Looking for Landmarks: The Role of Expert Review and Bibliometric Analysis in Evaluating Scientific Publication Outputs [J].
Allen, Liz ;
Jones, Ceri ;
Dolby, Kevin ;
Lynn, David ;
Walport, Mark .
PLOS ONE, 2009, 4 (06)
[3]  
Alon T., 2022, U RES MARKET HIGHER
[4]  
[Anonymous], 1981, INFLATION DEPRESSION
[5]   Incentives and creativity: evidence from the academic life sciences [J].
Azoulay, Pierre ;
Zivin, Joshua S. Graff ;
Manso, Gustavo .
RAND JOURNAL OF ECONOMICS, 2011, 42 (03) :527-554
[6]  
Banerjee S., 2014, Proceedings of the fifteenth ACM conference on Economics and computation, P149, DOI [10.1145/2600057.2602888, DOI 10.1145/2600057.2602888]
[7]   Bibliometric indicators: opportunities and limits [J].
Belter, Christopher W. .
JOURNAL OF THE MEDICAL LIBRARY ASSOCIATION, 2015, 103 (04) :219-221
[8]   Intrinsic and extrinsic motivation [J].
Bénabou, R ;
Tirole, J .
REVIEW OF ECONOMIC STUDIES, 2003, 70 (03) :489-520
[9]   Academic misconduct, misrepresentation and gaming: A reassessment [J].
Biagioli, Mario ;
Kenney, Martin ;
Martin, Ben R. ;
Walsh, John P. .
RESEARCH POLICY, 2019, 48 (02) :401-413
[10]   Watch out for cheats in citation game [J].
Biagioli, Mario .
NATURE, 2016, 535 (7611) :201-201