Is it all bafflegab? - Linguistic and meta characteristics of research articles in prestigious economics journals

被引:1
作者
Amon, Julian [1 ]
Hornik, Kurt [1 ]
机构
[1] Vienna Univ Econ & Business Adm, Inst Stat & Math, Welthandelspl 1, A-1020 Vienna, Austria
关键词
Research impact; SJR indicator; NLP; Readability; Gradient boosting; GLMLSS; R-PACKAGE; VARIABLE SELECTION; BETA REGRESSION; IMPACT; READABILITY; COLLABORATION; COMPLEXITY; MANAGEMENT; CITATIONS; RANKINGS;
D O I
10.1016/j.joi.2022.101284
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In competitive research environments, scholars have a natural interest to maximize the prestige associated with their scientific work. In order to identify factors that might help them address this goal more effectively, the scientometric literature has tried to link linguistic and meta characteristics of academic papers to the associated degree of scientific prestige, conceptualized as cumulative citation counts. In this paper, we take an alternative approach that instead understands scientific prestige in terms of the rankings of the journals that the articles appeared in, as such rankings are routinely used as surrogate research quality indicators. For the purpose of determining the most important drivers of suchlike prestige, we use state-of-the-art text mining tools to extract 344 interpretable features from a large corpus of over 200,000 journal articles in economics. We then estimate beta regression models to investigate the relationship between these predictors and a cross-sectionally standardized version of SCImago Journal Rank (SJR) in multiple topically homogeneous clusters. In so doing, we also reinvestigate the bafflegab theory, according to which more prestigious research papers tend to be less readable, in a methodologically novel way. Our results show the consistently most informative predictors to be associated with the length of the paper, the span of coreference chains in its full text, the deployment of a personal and moderately informal writing style, the "density" of the article in terms of sentences per page, international and institutional collaboration in research teams and the references cited in the paper. Moreover, we identify various linguistic intricacies that matter in the association between readability and scientific prestige, which suggest this relationship to be more complicated than previously assumed.
引用
收藏
页数:17
相关论文
共 73 条
[1]  
Abritis A, 2017, SCIENCE, DOI 10.1126/science.aan7214
[2]   Language use reflects scientific methodology: A corpus-based study of peer-reviewed journal articles [J].
Argamon, Shlomo ;
Dodick, Jeff ;
Chase, Paul .
SCIENTOMETRICS, 2008, 75 (02) :203-238
[3]  
Armstrong J.S, 1980, PSYCHOL TODAY, V12
[4]   READABILITY AND PRESTIGE IN SCIENTIFIC JOURNALS [J].
ARMSTRONG, JS .
JOURNAL OF INFORMATION SCIENCE, 1989, 15 (02) :123-124
[5]   UNINTELLIGIBLE MANAGEMENT RESEARCH AND ACADEMIC PRESTIGE [J].
ARMSTRONG, JS .
INTERFACES, 1980, 10 (02) :80-86
[6]  
Bayer F. M, 2014, ARXIV PREPRINT ARXIV
[7]   Latent Dirichlet allocation [J].
Blei, DM ;
Ng, AY ;
Jordan, MI .
JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (4-5) :993-1022
[8]   Heterogeneity of collaboration and its relationship with research impact in a biomedical field [J].
Bordons, Maria ;
Aparicio, Javier ;
Costas, Rodrigo .
SCIENTOMETRICS, 2013, 96 (02) :443-466
[9]  
Boyack KW, 2005, ISSI 2005: Proceedings of the 10th International Conference of the International Society for Scientometrics and Informetrics, Vols 1 and 2, P335
[10]   Predictive Effects of Structural Variation on Citation Counts [J].
Chen, Chaomei .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE AND TECHNOLOGY, 2012, 63 (03) :431-449