Comprehension of polarity of articles by citation sentiment analysis using TF-IDF and ML classifiers

被引:0
作者
Karim M. [1 ]
Missen M.M.S. [1 ]
Umer M. [1 ]
Fida A. [1 ]
Eshmawi A.A. [2 ]
Mohamed A. [3 ]
Ashraf I. [4 ]
机构
[1] Department of Computer Science & Information Technology, Islamia University, Bahawalpur
[2] University of Jeddah, Department of Cybersecurity, College of Computer Science and Engineering, Jeddah
[3] University Research Centre, Future University, Cairo
[4] Information and Communication Engineering, Yeungnam University, Gyeongsan
关键词
Citation sentiment analysis; Dataset balancing; Machine learning; SMOTE; Term frequency-inverse document frequency;
D O I
10.7717/PEERJ-CS.1107
中图分类号
学科分类号
摘要
Sentiment analysis has been researched extensively during the last few years, however, the sentiment analysis of citations in a research article is an unexplored research area. Sentiment analysis of citations can provide new applications in bibliometrics and provide insights for a better understanding of scientific knowledge. Citation count, as it is used today to measure the quality of a paper, does not portray the quality of a scientific article, as the article may be cited to indicate its weakness. So determining the polarity of a citation is an important task to quantify the quality of the cited article and ascertain its impact and ranking. This article presents an approach to determine the polarity of the cited article using term frequency-inverse document frequency and machine learning classifiers. To analyze the influence of an imbalanced dataset, several experiments are performed with and without the synthetic minority oversampling technique (SMOTE) and uni-gram and bi-gram term frequency-inverse document frequency (TF-IDF). Results indicate that the proposed methodology achieves high accuracy of 99.0% with the extra tree classifier when trained on SMOTE oversampled dataset and bi-gram features. © Karim 2022 et al.
引用
收藏
相关论文
共 42 条
  • [31] Schapire RE, Singer Y., Improved boosting algorithms using confidence-rated predictions, Machine Learning, 37, 3, pp. 297-336, (1999)
  • [32] Scholkopf B, Burges C, Vapnik V., Incorporating invariances in support vector learning machines, International conference on artificial neural networks, pp. 47-52, (1996)
  • [33] Sendhilkumar S, Elakkiya E, Mahalakshmi G., Citation semantic based approaches to identify article quality, Proceedings ofinternational conference ICCSEA, pp. 411-420, (2013)
  • [34] Sharaff A, Gupta H., Extra-tree classifier with metaheuristics approach for email classification, Advances in Computer Communication and Computational Sciences, pp. 189-197, (2019)
  • [35] Shmilovici A., Support vector machines, Data mining and knowledge discovery handbook, pp. 231-247, (2009)
  • [36] Tan P-N, Steinbach M, Kumar V., Introduction to data mining, (2006)
  • [37] Teufel S, Siddharthan A, Tidhar D., Automatic classification of citation function, Proceedings ofthe 2006 conference on empirical methods in natural language processing, pp. 103-110, (2006)
  • [38] Twala B., Multiple classifier application to credit risk assessment, Expert Systems with Applications, 37, 4, pp. 3326-3336, (2010)
  • [39] Wan X, Liu F., Are all literature citations equally important? Automatic citation strength estimation and its applications, Journal ofthe Association for Information Science and Technology, 65, 9, pp. 1929-1938, (2014)
  • [40] West JD, Jensen MC, Dandrea RJ, Gordon GJ, Bergstrom CT., Author-level Eigenfactor metrics: evaluating the influence of authors, institutions, and countries within the social science research network community, Journal ofthe American Society for Information Science and Technology, 64, 4, pp. 787-801, (2013)