Multiple Citation Indicators and Their Composite across Scientific Disciplines

被引:90
作者
Ioannidis, John P. A. [1 ,2 ,3 ,4 ]
Klavans, Richard [5 ]
Boyack, Kevin W. [6 ]
机构
[1] Stanford Univ, Meta Res Innovat Ctr Stanford METR, Stanford, CA 94305 USA
[2] Stanford Univ, Sch Med, Dept Med, Stanford Prevent Res Ctr, Stanford, CA 94305 USA
[3] Stanford Univ, Sch Med, Dept Hlth Res & Policy, Stanford, CA 94305 USA
[4] Stanford Univ, Sch Humanities & Sci, Dept Stat, Stanford, CA 94305 USA
[5] SciTech Strategies Inc, Wayne, PA USA
[6] SciTech Strategies Inc, Albuquerque, NM USA
关键词
H-INDEX; BIBLIOMETRIC INDICATORS; AUTHORSHIP; RESEARCHERS; SCIENCE; ORDER;
D O I
10.1371/journal.pbio.1002501
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
Many fields face an increasing prevalence of multi-authorship, and this poses challenges in assessing citation metrics. Here, we explore multiple citation indicators that address total impact (number of citations, Hirsch H index [H]), co-authorship adjustment (Schreiber Hm index [Hm]), and author order (total citations to papers as single; single or first; or single, first, or last author). We demonstrate the correlation patterns between these indicators across 84,116 scientists (those among the top 30,000 for impact in a single year [2013] in at least one of these indicators) and separately across 12 scientific fields. Correlation patterns vary across these 12 fields. In physics, total citations are highly negatively correlated with indicators of co-authorship adjustment and of author order, while in other sciences the negative correlation is seen only for total citation impact and citations to papers as single author. We propose a composite score that sums standardized values of these six log-transformed indicators. Of the 1,000 top-ranked scientists with the composite score, only 322 are in the top 1,000 based on total citations. Many Nobel laureates and other extremely influential scientists rank among the top-1,000 with the composite indicator, but would rank much lower based on total citations. Conversely, many of the top 1,000 authors on total citations have had no single/first/last-authored cited paper. More Nobel laureates of 2011-2015 are among the top authors when authors are ranked by the composite score than by total citations, H index, or Hm index; 40/47 of these laureates are among the top 30,000 by at least one of the six indicators. We also explore the sensitivity of indicators to self-citation and alphabetic ordering of authors in papers across different scientific fields. Multiple indicators and their composite may give a more comprehensive picture of impact, although no citation indicator, single or composite, can be expected to select all the best scientists.
引用
收藏
页数:17
相关论文
共 44 条
[11]   Theory and practise of the g-index [J].
Egghe, Leo .
SCIENTOMETRICS, 2006, 69 (01) :131-152
[12]   What is in a name? Credit assignment practices in different disciplines [J].
Frandsen, Tove Faber ;
Nicolaisen, Jeppe .
JOURNAL OF INFORMETRICS, 2010, 4 (04) :608-617
[13]   Author disambiguation using multi-aspect similarity indicators [J].
Gurney, Thomas ;
Horlings, Edwin ;
van den Besselaar, Peter .
SCIENTOMETRICS, 2012, 91 (02) :435-449
[14]   The Leiden Manifesto for research metrics [J].
Hicks, Diana ;
Wouters, Paul ;
Waltman, Ludo ;
de Rijcke, Sarah ;
Rafols, Ismael .
NATURE, 2015, 520 (7548) :429-431
[15]   Does the h index have predictive power? [J].
Hirsch, J. E. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2007, 104 (49) :19193-19198
[16]   An index to quantify an individual's scientific research output [J].
Hirsch, JE .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (46) :16569-16572
[17]   DO ABCs GET MORE CITATIONS THAN XYZs? [J].
Huang, Wei .
ECONOMIC INQUIRY, 2015, 53 (01) :773-789
[18]   How to Make More Published Research True [J].
Ioannidis, John P. A. .
PLOS MEDICINE, 2014, 11 (10)
[19]   Assessing Value in Biomedical Research The PQRST of Appraisal and Reward [J].
Ioannidis, John P. A. ;
Khoury, Muin J. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2014, 312 (05) :483-484
[20]   Estimates of the Continuously Publishing Core in the Scientific Workforce [J].
Ioannidis, John P. A. ;
Boyack, Kevin W. ;
Klavans, Richard .
PLOS ONE, 2014, 9 (07)