A 'power law' based method to reduce size-related bias in indicators of knowledge performance: An application to university research assessment

被引:2
作者
Calabrese, Armando [1 ]
Capece, Guendalina [1 ]
Costa, Roberta [1 ]
Di Pillo, Francesca [1 ]
Giuffrida, Stefania [2 ]
机构
[1] Univ Roma Tor Vergata, Dept Enterprise Engn, Rome, Italy
[2] CNR, Rome, Italy
关键词
Knowledge performance; Research assessment; Research productivity indicators; Power laws; Dimensional bias; Scale-free property; STATISTICAL PROPERTIES; SCALING BEHAVIOR; RESEARCH QUALITY; GROWTH DYNAMICS; TRIPLE-HELIX; INNOVATION; IMPACT; SYSTEMS; MODEL; OUTPUT;
D O I
10.1016/j.joi.2018.10.005
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The knowledge production provided by universities is essential to sustaining a country's long-term economic growth and international competitiveness. Many nations are thus driving to create sustainable and effective funding environments. The evaluation of university knowledge, productivity and research quality becomes critical, with ever increasing share of public funding allocated on the basis of research assessment exercises. Nevertheless, the existing methods to assess the universities' knowledge production are often affected by limits and biases, extensively discussed in the scientific literature. In this paper we study how to reduce the effect of size-related bias due to university size on the indicators of knowledge performance used in evaluation exercises. We propose an innovative utilization of the scale-free property of the power laws as a scaling relationship, to normalize research productivity indicators, and provide results independent by the university size. Our method has evident policy implications and gives a contribution for the future design of assessment exercises. We apply our findings in a recent Italian research assessment exercise. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1263 / 1281
页数:19
相关论文
共 71 条
[1]   Revisiting the scaling of citations for research assessment [J].
Abramo, Giovanni ;
Cicero, Tindaro ;
D'Angelo, Ciriaco Andrea .
JOURNAL OF INFORMETRICS, 2012, 6 (04) :470-479
[2]   National research assessment exercises: the effects of changing the rules of the game during the game [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea ;
Di Costa, Flavia .
SCIENTOMETRICS, 2011, 88 (01) :229-238
[3]   The dangers of performance-based research funding in non-competitive higher education systems [J].
Abramo, Giovanni ;
Cicero, Tindaro ;
D'Angelo, Ciriaco Andrea .
SCIENTOMETRICS, 2011, 87 (03) :641-654
[4]  
Adams J., 2011, FUNDING RES EXCELLEN
[5]   Assessing the impact of nonresponse on work grroup diversity effects [J].
Allen, Natalie J. ;
Stanley, David J. ;
Williams, Helen M. ;
Ross, Sarah J. .
ORGANIZATIONAL RESEARCH METHODS, 2007, 10 (02) :262-286
[6]  
Amaral LAN, 1997, J PHYS I, V7, P621
[7]  
[Anonymous], 1896, ANN AM ACAD POLITICA, DOI DOI 10.1177/000271629700900314
[8]  
[Anonymous], 2008, Research Assessment Exercise
[9]  
[Anonymous], 1983, FRACTAL GEOMETRY NAT
[10]  
[Anonymous], 2006, The Knowledge-Based Economy: Modeled, Measured, Simulated