Research assessment using early citation information

被引:19
作者
Bruns, Stephan B. [1 ,2 ]
Stern, David I. [3 ]
机构
[1] Univ Kassel, Meta Res Econ Grp, Nora Platiel Str 5, D-34109 Kassel, Germany
[2] Univ Kassel, INCHER, Nora Platiel Str 5, D-34109 Kassel, Germany
[3] Australian Natl Univ, Crawford Sch Publ Policy, 132 Lennox Crossing, Acton, ACT 2601, Australia
关键词
Citations; Research assessment; Bibliometrics; CHANGING RESEARCH LANDSCAPE; BIBLIOMETRIC EVALUATION; IMPACT; ECONOMICS; SCIENTOMETRICS; PERFORMANCE; DEPARTMENTS; COUNTS; PANELS; RAE;
D O I
10.1007/s11192-016-1979-1
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Peer-review based research assessment, as implemented in Australia, the United Kingdom, and some other countries, is a very costly exercise. We show that university rankings in economics based on long-run citation counts can be easily predicted using early citations. This would allow a research assessment to predict the relative long-run impact of articles published by a university immediately at the end of the evaluation period. We compare these citation-based university rankings with the rankings of the 2010 Excellence in Research assessment in Australia and the 2008 Research Assessment Exercise in the United Kingdom. Rank correlations are quite strong, but there are some differences between rankings. However, if assessors are willing to consider citation analysis to assess some disciplines, as is the case for the natural sciences and psychology in Australia, it seems reasonable to consider also including economics in that set.
引用
收藏
页码:917 / 935
页数:19
相关论文
共 37 条
[1]   Early citation counts correlate with accumulated impact [J].
Adams, J .
SCIENTOMETRICS, 2005, 63 (03) :567-581
[2]   The New Zealand performance-based research fund and its impact on publication activity in economics [J].
Anderson, David L. ;
Tressler, John .
RESEARCH EVALUATION, 2014, 23 (01) :1-11
[3]   Bibliometric evaluation vs. informed peer review: Evidence from Italy [J].
Bertocchi, Graziella ;
Gambardella, Alfonso ;
Jappelli, Tullio ;
Nappi, Carmela A. ;
Peracchi, Franco .
RESEARCH POLICY, 2015, 44 (02) :451-466
[4]   How much does the expected number of citations for a publication change if it contains the address of a specific scientific institute? A new approach for the analysis of citation data on the institutional level based on regression models [J].
Bornmann, Lutz .
JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, 2016, 67 (09) :2274-2282
[5]  
Bornmann L, 2014, EMBO REP, V15, P1228, DOI 10.15252/embr.201439608
[6]   Scientific Peer Review [J].
Bornmann, Lutz .
ANNUAL REVIEW OF INFORMATION SCIENCE AND TECHNOLOGY, 2011, 45 :199-245
[7]   Peer Review vs Metric-based Assessment: Testing for Bias in the RAE Ratings of UK Economics Departments [J].
Clerides, Sofronis ;
Pashardes, Panos ;
Polycarpou, Alexandros .
ECONOMICA, 2011, 78 (311) :565-583
[8]   A BIBLIOMETRIC EVALUATION OF THE RESEARCH PERFORMANCE OF BRITISH UNIVERSITY POLITICS DEPARTMENTS - PUBLICATIONS IN LEADING JOURNALS [J].
COLMAN, AM ;
DHILLON, D ;
COULTHARD, B .
SCIENTOMETRICS, 1995, 32 (01) :49-66
[9]  
Farla K., 2015, REF ACCOUNTABILITY R
[10]   The Validation of Peer Review through Research Impact Measures and the Implications for Funding Strategies [J].
Gallo, Stephen A. ;
Carpenter, Afton S. ;
Irwin, David ;
McPartland, Caitlin D. ;
Travis, Joseph ;
Reynders, Sofie ;
Thompson, Lisa A. ;
Glisson, Scott R. .
PLOS ONE, 2014, 9 (09)