How to analyze percentile citation impact data meaningfully in bibliometrics: The statistical analysis of distributions, percentile rank classes, and top-cited papers

被引:56
作者
Bornmann, Lutz [1 ]
机构
[1] Adm Headquarters Max Planck Soc, Div Sci & Innovat Studies, D-80539 Munich, Germany
来源
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY | 2013年 / 64卷 / 03期
关键词
bibliometrics; PREDICTIVE-VALIDITY; INDICATORS; EXCELLENCE; COUNTS;
D O I
10.1002/asi.22792
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
According to current research in bibliometrics, percentiles (or percentile rank classes) are the most suitable method for normalizing the citation counts of individual publications in terms of the subject area, the document type, and the publication year. Up to now, bibliometric research has concerned itself primarily with the calculation of percentiles. This study suggests how percentiles (and percentile rank classes) can be analyzed meaningfully for an evaluation study. Publication sets from four universities are compared with each other to provide sample data. These suggestions take into account on the one hand the distribution of percentiles over the publications in the sets (universities here) and on the other hand concentrate on the range of publications with the highest citation impactthat is, the range that is usually of most interest in the evaluation of scientific performance.
引用
收藏
页码:587 / 595
页数:9
相关论文
共 43 条
[1]   The skewness of science in 219 sub-fields and a number of aggregates [J].
Albarran, Pedro ;
Crespo, Juan A. ;
Ortuno, Ignacio ;
Ruiz-Castillo, Javier .
SCIENTOMETRICS, 2011, 88 (02) :385-397
[2]  
[Anonymous], 2011, Stata Statistical Software: Release 12
[3]  
[Anonymous], 2018, GEN LINEAR MODELS EX
[4]   What do citation counts measure? A review of studies on citing behavior [J].
Bornmann, Luti ;
Daniel, Hans-Dieter .
JOURNAL OF DOCUMENTATION, 2008, 64 (01) :45-80
[5]   What do we know about the h index? [J].
Bornmann, Lutz ;
Daniel, Hans-Dieter .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2007, 58 (09) :1381-1385
[6]   The new Excellence Indicator in the World Report of the SCImago Institutions Rankings 2011 [J].
Bornmann, Lutz ;
de Moya Anegon, Felix ;
Leydesdorff, Loet .
JOURNAL OF INFORMETRICS, 2012, 6 (02) :333-335
[7]   What factors determine citation counts of publications in chemistry besides their quality? [J].
Bornmann, Lutz ;
Schier, Hermann ;
Marx, Werner ;
Daniel, Hans-Dieter .
JOURNAL OF INFORMETRICS, 2012, 6 (01) :11-18
[8]   A multilevel modelling approach to investigating the predictive validity of editorial decisions: do the editors of a high profile journal select manuscripts that are highly cited after publication? [J].
Bornmann, Lutz ;
Mutz, Ruediger ;
Marx, Werner ;
Schier, Hermann ;
Daniel, Hans-Dieter .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY, 2011, 174 :857-879
[9]   Is Interactive Open Access Publishing Able to Identify High-Impact Submissions? A Study on the Predictive Validity of Atmospheric Chemistry and Physics by Using Percentile Rank Classes [J].
Bornmann, Lutz ;
Schier, Hermann ;
Marx, Werner ;
Daniel, Hans-Dieter .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2011, 62 (01) :61-71
[10]   Further steps towards an ideal method of measuring citation performance: The avoidance of citation (ratio) averages in field-normalization [J].
Bornmann, Lutz ;
Mutz, Ruediger .
JOURNAL OF INFORMETRICS, 2011, 5 (01) :228-230