Research assessment by percentile-based double rank analysis

被引:16
作者
Brito, Ricardo [1 ,2 ]
Rodriguez-Navarro, Alonso [1 ,2 ,3 ]
机构
[1] Univ Complutense Madrid, Dept Estruct Mat Fis Term & Elect, Plaza Ciencias 3, E-28040 Madrid, Spain
[2] Univ Complutense Madrid, GISC, Plaza Ciencias 3, E-28040 Madrid, Spain
[3] Univ Politecn Madrid, Dept Biotecnol Biol Vegetal, Ave Puerta de Hierro 2, E-28040 Madrid, Spain
关键词
Research assessment; Bibliometric analysis; Citation distribution; Double-rank analysis; Percentile distribution; HIGHLY CITED PAPERS; SIZE-INDEPENDENT INDICATORS; CITATION IMPACT; BIBLIOMETRIC INDICATORS; PERFORMANCE INDICATORS; SCIENTIFIC EXCELLENCE; BASIC RESEARCH; DISTRIBUTIONS; PUBLICATIONS; UNIVERSALITY;
D O I
10.1016/j.joi.2018.01.011
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In the double rank analysis of research publications, the local rank position of a country or institution publication is expressed as a function of the world rank position. Excluding some highly or lowly cited publications, the double rank plot fits well with a power law, which can be explained because citations for local and world publications follow lognormal distributions. We report here that the distribution of the number of country or institution publications in world percentiles is a double rank distribution that can be fitted to a power law. Only the data points in high percentiles deviate from it when the local and world parameters of the lognormal distributions are very different. The likelihood of publishing very highly cited papers can be calculated from the power law that can be fitted either to the upper tail of the citation distribution or to the percentile-based double rank distribution. The great advantage of the latter method is that it has universal application, because it is based on all publications and not just on highly cited publications. Furthermore, this method extends the application of the well-established percentile approach to very low percentiles where breakthroughs are reported but paper counts cannot be performed. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:315 / 329
页数:15
相关论文
共 80 条
[1]   A farewell to the MNCS and like size-independent indicators: Rejoinder [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea .
JOURNAL OF INFORMETRICS, 2016, 10 (02) :679-683
[2]   How do you define and measure research productivity? [J].
Abramo, Giovanni ;
D'Angelo, Ciriaco Andrea .
SCIENTOMETRICS, 2014, 101 (02) :1129-1144
[3]   Profiling citation impact: A new methodology [J].
Adams, Jonathan ;
Gurney, Karen ;
Marshall, Stuart .
SCIENTOMETRICS, 2007, 72 (02) :325-344
[4]   A Report from the International Mathematical Union (IMU) in Cooperation with the International Council of Industrial and Applied Mathematics (ICIAM) and the Institute of Mathematical Statistics (IMS) [J].
Adler, Robert ;
Ewing, John ;
Taylor, Peter ;
Hall, Peter Gavin .
STATISTICAL SCIENCE, 2009, 24 (01) :1-28
[5]   The effect of highly cited papers on national citation indicators [J].
Aksnes, DW ;
Sivertsen, G .
SCIENTOMETRICS, 2004, 59 (02) :213-224
[6]   Peer reviews and bibliometric indicators: a comparative study at a Norwegian university [J].
Aksnes, DW ;
Taxt, RE .
RESEARCH EVALUATION, 2004, 13 (01) :33-41
[7]   Differences in Citation Impact Across Countries [J].
Albarran, Pedro ;
Perianes-Rodriguez, Antonio ;
Ruiz-Castillo, Javier .
JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY, 2015, 66 (03) :512-525
[8]   Average-based versus high- and low-impact indicators for the evaluation of scientific distributions [J].
Albarran, Pedro ;
Ortufno, Ignacio ;
Ruiz-Castillo, Javier .
RESEARCH EVALUATION, 2011, 20 (04) :325-339
[9]   The skewness of science in 219 sub-fields and a number of aggregates [J].
Albarran, Pedro ;
Crespo, Juan A. ;
Ortuno, Ignacio ;
Ruiz-Castillo, Javier .
SCIENTOMETRICS, 2011, 88 (02) :385-397
[10]   The measurement of low- and high-impact in citation distributions: Technical results [J].
Albarran, Pedro ;
Ortuno, Ignacio ;
Ruiz-Castillo, Javier .
JOURNAL OF INFORMETRICS, 2011, 5 (01) :48-63