Research assessment using early citation information

被引:19
作者
Bruns, Stephan B. [1 ,2 ]
Stern, David I. [3 ]
机构
[1] Univ Kassel, Meta Res Econ Grp, Nora Platiel Str 5, D-34109 Kassel, Germany
[2] Univ Kassel, INCHER, Nora Platiel Str 5, D-34109 Kassel, Germany
[3] Australian Natl Univ, Crawford Sch Publ Policy, 132 Lennox Crossing, Acton, ACT 2601, Australia
关键词
Citations; Research assessment; Bibliometrics; CHANGING RESEARCH LANDSCAPE; BIBLIOMETRIC EVALUATION; IMPACT; ECONOMICS; SCIENTOMETRICS; PERFORMANCE; DEPARTMENTS; COUNTS; PANELS; RAE;
D O I
10.1007/s11192-016-1979-1
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Peer-review based research assessment, as implemented in Australia, the United Kingdom, and some other countries, is a very costly exercise. We show that university rankings in economics based on long-run citation counts can be easily predicted using early citations. This would allow a research assessment to predict the relative long-run impact of articles published by a university immediately at the end of the evaluation period. We compare these citation-based university rankings with the rankings of the 2010 Excellence in Research assessment in Australia and the 2008 Research Assessment Exercise in the United Kingdom. Rank correlations are quite strong, but there are some differences between rankings. However, if assessors are willing to consider citation analysis to assess some disciplines, as is the case for the natural sciences and psychology in Australia, it seems reasonable to consider also including economics in that set.
引用
收藏
页码:917 / 935
页数:19
相关论文
共 37 条
[21]   Comparison of a citation-based indicator and peer review for absolute and specific measures of research-group excellence [J].
Mryglod, O. ;
Kenna, R. ;
Holovatch, Yu. ;
Berche, B. .
SCIENTOMETRICS, 2013, 97 (03) :767-777
[22]   The Contribution of Australian Academia to the World's Best Economics Research: 2001 to 2010 [J].
Neri, Frank ;
Rodgers, Joan .
ECONOMIC RECORD, 2015, 91 (292) :107-124
[23]   Citation counts and the Research Assessment Exercise V - Archaeology and the 2001 RAE [J].
Norris, M ;
Oppenheim, C .
JOURNAL OF DOCUMENTATION, 2003, 59 (06) :709-730
[24]  
Oppenheim C., 1996, SERIALS J SERIALS CO, V9, P155, DOI 10.1629/09155
[25]  
Ostriker J.P., 2011, A data-based assessment of research-doctorate programs in the United States
[26]  
Regibeau P., 2014, DISCUSSION PAPER SER, V757
[27]  
Sayer Derek., 2014, Rank Hypocrisies: The Insult of the REF
[28]   HOW SHOULD PEER-REVIEW PANELS BEHAVE? [J].
Sgroi, Daniel ;
Oswald, Andrew J. .
ECONOMIC JOURNAL, 2013, 123 (570) :F255-F278
[29]   High-Ranked Social Science Journal Articles Can Be Identified from Early Citation Information [J].
Stern, David I. .
PLOS ONE, 2014, 9 (11)
[30]   Towards a European economics of economics:: Monitoring a decade of top research and providing some explanation [J].
Süssmuth, B ;
Steininger, M ;
Ghio, S .
SCIENTOMETRICS, 2006, 66 (03) :579-612