Is citation normalization realistic?

被引:15
作者
Kostoff, RN [1 ]
Martinez, WL [1 ]
机构
[1] Off Naval Res, Arlington, VA 22217 USA
关键词
citation analysis; citation normalization; document clustering; research evaluation;
D O I
10.1177/0165551505049260
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One method for assessing quality of research outputs across different technical disciplines is comparing citations received by the research output documents. However, cross-discipline citation comparison studies require discipline normalization, in order to eliminate discipline differences in cultural citation practices and discipline differences in the number of active researchers available to cite. The 'definition' of, and number of documents used to represent, a discipline become critical. This study attempted to determine whether the citation characteristics (average, median) of a discipline's domain stabilized as the domain's size was decreased. A sample of papers (classified as research articles only, not review articles, by the Institute for Scientific Information) published in the journal Oncogene in 1999 was clustered hierarchically, and the citation averages and medians were computed for each cluster at different cluster hierarchical levels. The citation characteristics became increasingly stratified as the clusters were reduced in size, raising serious questions about the credibility of a selected denominator for normalization studies. An interesting side result occurred when all the retrieved articles were sorted by number of citations. Thirteen of the fifty most highly cited research articles had 100 or more references, whereas zero of the fifty least cited research articles had 100 or more references.
引用
收藏
页码:57 / 61
页数:5
相关论文
共 6 条
  • [1] KARYPIS G, 2004, CLUTO CLUSTERING TOO
  • [2] Citation analysis of research performer quality
    Kostoff, RN
    [J]. SCIENTOMETRICS, 2002, 53 (01) : 49 - 71
  • [3] Citation mining:: Integrating text mining and bibliometrics for research user profiling
    Kostoff, RN
    del Río, JA
    Humenik, JA
    García, EO
    Ramírez, AM
    [J]. JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2001, 52 (13): : 1148 - 1156
  • [4] NARIN F, C637 NSF
  • [5] Cross-field normalization of scientometric indicators
    Schubert, A
    Braun, T
    [J]. SCIENTOMETRICS, 1996, 36 (03) : 311 - 324
  • [6] ZHAO Y, IN PRESS MACHINE LEA