What is the appropriate length of the publication period over which to assess research performance?

被引:49
作者
Abramo, Giovanni [1 ,2 ]
D'Angelo, Ciriaco Andrea [1 ]
Cicero, Tindaro [1 ]
机构
[1] Univ Roma Tor Vergata, Dipartimento Ingn Impresa, Lab Studies Res & Technol Transfer, I-00133 Rome, Italy
[2] Natl Res Council Italy, Inst Syst Anal & Comp Sci, I-00185 Rome, Italy
关键词
Research evaluation; Bibliometrics; Publication period; Sensitivity analysis; Research productivity; Universities; CITATION; SCIENCE; LEVEL;
D O I
10.1007/s11192-012-0714-9
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
National research assessment exercises are conducted in different nations over varying periods. The choice of the publication period to be observed has to address often contrasting needs: it has to ensure the reliability of the results issuing from the evaluation, but also reach the achievement of frequent assessments. In this work we attempt to identify which is the most appropriate or optimal publication period to be observed. For this, we analyze the variation of individual researchers' productivity rankings with the length of the publication period within the period 2003-2008, by the over 30,000 Italian university scientists in the hard sciences. First we analyze the variation in rankings referring to pairs of contiguous and overlapping publication periods, and show that the variations reduce markedly with periods above 3 years. Then we will show the strong randomness of performance rankings over publication periods under 3 years. We conclude that the choice of a 3 year publication period would seem reliable, particularly for physics, chemistry, biology and medicine.
引用
收藏
页码:1005 / 1017
页数:13
相关论文
共 18 条
  • [1] Abramo G, 2007, CURR SCI INDIA, V93, P762
  • [2] A sensitivity analysis of researchers' productivity rankings to the time of citation observation
    Abramo, Giovanni
    Cicero, Tindaro
    D'Angelo, Ciriaco Andrea
    [J]. JOURNAL OF INFORMETRICS, 2012, 6 (02) : 192 - 201
  • [3] Assessing the varying level of impact measurement accuracy as a function of the citation window length
    Abramo, Giovanni
    Cicero, Tindaro
    D'Angelo, Ciriaco Andrea
    [J]. JOURNAL OF INFORMETRICS, 2011, 5 (04) : 659 - 667
  • [4] National-scale research performance assessment at the individual level
    Abramo, Giovanni
    D'Angelo, Ciriaco Andrea
    [J]. SCIENTOMETRICS, 2011, 86 (02) : 347 - 364
  • [5] Editorial and publication delay of papers submitted to 14 selected Food Research journals. Influence of online posting
    Amat, Carlos B.
    [J]. SCIENTOMETRICS, 2008, 74 (03) : 379 - 389
  • [6] [Anonymous], CITATION ANAL RES EV
  • [7] Bhattacharya A., 2010, DISCUSSION PAPERS U
  • [8] Modelling citation age data: Simple graphical methods from reliability theory
    Burrell, QL
    [J]. SCIENTOMETRICS, 2002, 55 (02) : 273 - 285
  • [9] Modifying publication practices in response to funding formulas
    Butler, L
    [J]. RESEARCH EVALUATION, 2003, 12 (01) : 39 - 46
  • [10] A Heuristic Approach to Author Name Disambiguation in Bibliometrics Databases for Large-Scale Research Assessments
    D'Angelo, Ciriaco Andrea
    Giuffrida, Cristiano
    Abramo, Giovanni
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2011, 62 (02): : 257 - 269