A sensitivity analysis of research institutions' productivity rankings to the time of citation observation

被引：8

作者：

Abramo, Giovanni ^{[1
,2
]}

Cicero, Tindaro ^{[1
]}

D'Angelo, Ciriaco Andrea ^{[1
]}

机构：

[1] Univ Roma Tor Vergata, Dept Management, Sch Engn, Lab Studies Res & Technol Transfer, Rome, Italy

[2] CNR, IASI, Inst Syst Anal & Comp Sci, I-00185 Rome, Italy

来源：

JOURNAL OF INFORMETRICS | 2012年 / 6卷 / 02期

关键词：

Research evaluation; Bibliometrics; Citation window; Productivity; Universities; Rankings;

D O I：

10.1016/j.joi.2011.11.005

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

One of the critical issues in bibliometric research assessments is the time required to achieve maturity in citations. Citation counts can be considered a reliable proxy of the real impact of a work only if they are observed after sufficient time has passed from publication date. In the present work the authors investigate the effect of varying the time of citation observation on accuracy of productivity rankings for research institutions. Research productivity measures are calculated for all Italian universities active in the hard sciences in the 2001-2003 period, by individual field and discipline, with the time of the citation observation varying from 2004 to 2008. The objective is to support policy-makers in choosing a citation window that optimizes the tradeoff between accuracy of rankings and timeliness of the exercise. (C) 2011 Elsevier Ltd. All rights reserved.

引用

页码：298 / 306

页数：9

共 15 条

[1] Assessment of sectoral aggregation distortion in research productivity measurements [J].

Abramo, Giovanni ;

D'Angelo, Ciriaco Andrea ;

Di Costa, Flavia .

RESEARCH EVALUATION, 2008, 17 (02) :111-121

[2] Assessing the varying level of impact measurement accuracy as a function of the citation window length [J].

Abramo, Giovanni ;

Cicero, Tindaro ;

D'Angelo, Ciriaco Andrea .

JOURNAL OF INFORMETRICS, 2011, 5 (04) :659-667

[3] A field-standardized application of DEA to national-scale research assessment of universities [J].

Abramo, Giovanni ;

Cicero, Tindaro ;

D'Angelo, Ciriaco Andrea .

JOURNAL OF INFORMETRICS, 2011, 5 (04) :618-628

[4] Evaluating research: from informed peer review to bibliometrics [J].

Abramo, Giovanni ;

D'Angelo, Ciriaco Andrea .

SCIENTOMETRICS, 2011, 87 (03) :499-514

[5] Early citation counts correlate with accumulated impact [J].

Adams, J .

SCIENTOMETRICS, 2005, 63 (03) :567-581

[6] A Heuristic Approach to Author Name Disambiguation in Bibliometrics Databases for Large-Scale Research Assessments [J].

D'Angelo, Ciriaco Andrea ;

Giuffrida, Cristiano ;

Abramo, Giovanni .

JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2011, 62 (02) :257-269

[7]

ERA, 2010, EXC RES AUSTR ERA IN

[8] Better late than never?: On the chance to become highly cited only beyond the standard bibliometric time horizon [J].

Glänzel, W ;

Schlemmer, B ;

Thijs, B .

SCIENTOMETRICS, 2003, 58 (03) :571-586

[9] Lifting the crown-citation z-score [J].

Lundberg, Jonas .

JOURNAL OF INFORMETRICS, 2007, 1 (02) :145-154

[10] The use and misuse of journal metrics and other citation indicators [J].

Pendlebury, David A. .

ARCHIVUM IMMUNOLOGIAE ET THERAPIAE EXPERIMENTALIS, 2009, 57 (01) :1-11

← 1 2 →