Sentiment Analysis and Comprehensive Evaluation of Supervised Machine Learning Models Using Twitter Data on Russia–Ukraine War

被引:9
作者
Wadhwani G.K. [1 ]
Varshney P.K. [1 ]
Gupta A. [1 ]
Kumar S. [2 ]
机构
[1] Department of Computer Science, IITM, GGSIPU, New Delhi
[2] Department of Computer Science and Engineering, Shoolini University, Himachal Pradesh, Solan
关键词
Feature engineering; Machine learning; Sentiment analysis; Supervised machine learning models; Text classification;
D O I
10.1007/s42979-023-01790-5
中图分类号
学科分类号
摘要
The Russia–Ukrainian War refers to the ongoing hostilities between Russia and Ukraine. It was first focused on whether Crimea and the Donbass were formally recognised as being a part of Ukraine when Russia started it in February 2014. The conflict dramatically grew when Russia began its incursion of Ukraine on February 24, 2022, following a military build-up on the Russian–Ukrainian border that started in late 2021. Examining public perceptions of the crisis between Russia and Ukraine is the goal of this piece. These days, social media has taken on a significant role in communication, and as a result, opinions can be found on platforms like Facebook, Twitter, and Instagram. The study makes use of his 11,250 tweets about the war between Russia and Ukraine from his Twitter account. Techniques, including image processing, object identification, and natural language processing, have shown application, power, and potential for machine learning. The same applies to text analytics. For text analysis, sentiment analysis, and entity annotation, machine learning techniques are frequently employed. According to the applicability and efficacy of the machine learning model, natural language processing toolkit in python is utilised in to examine the textual polarity and subjectivity score of tweets. Moreover, because machine learning models have a high degree of classification accuracy, they have been widely utilised to categorise emotions. We have developed and test models using three feature extraction techniques: TF-IDF (term frequency-inverse document frequency), BoW (bag of words), and N-gram. Each model was assessed using a number of important performance indicators, including accuracy, precision, recall, and F1 score. Results show that the extra trees classifier (ETC) model achieves a highest accuracy of 0.84 in combination with the Bow property which is a measure to evaluate the efficacy of a machine learning algorithm. Logistic regression (LR), decision tree (DT), support vector machine (SVM), XGB, Gaussian naive base (GNB), ADA, and K-nearest neighbours (KNN) comparison have also been made. © 2023, The Author(s), under exclusive licence to Springer Nature Singapore Pte Ltd.
引用
收藏
相关论文
共 50 条
[41]   Various Machine Learning Algorithms for Twitter Sentiment Analysis [J].
Singh, Rishija ;
Goel, Vikas .
INFORMATION AND COMMUNICATION TECHNOLOGY FOR COMPETITIVE STRATEGIES, 2019, 40 :763-772
[42]   Food Review Analysis and Sentiment Prediction using Machine Learning Models [J].
Gupta, Dhruv ;
Roup, Ausho ;
Gupta, Diksha ;
Ratre, Avinash .
2022 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL, COMPUTING, COMMUNICATION AND SUSTAINABLE TECHNOLOGIES (ICAECT), 2022,
[43]   Arabic Sentiment Analysis using Deep Learning for COVID-19 Twitter Data [J].
Alhumoud, Sarah .
INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2020, 20 (09) :132-138
[44]   Sentiment analysis of Twitter data during Farmers' Protest in India through Machine Learning [J].
Singh, Abhiraj ;
Kalra, Nidhi ;
Singh, Amritpal ;
Sharma, Seemu .
PROCEEDING OF THE 2ND 2022 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (CSASE 2022), 2022, :121-126
[45]   Sentiment Analysis on Twitter data with Semi-Supervised Doc2Vec [J].
Bilgin, Metin ;
Senturk, Izzet Fatih .
2017 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ENGINEERING (UBMK), 2017, :661-666
[46]   Sentiment analysis on Twitter data integrating TextBlob and deep learning models: The case of US airline industry [J].
Aljedaani, Wajdi ;
Rustam, Furqan ;
Mkaouer, Mohamed Wiem ;
Ghallab, Abdullatif ;
Rupapara, Vaibhav ;
Washington, Patrick Bernard ;
Lee, Ernesto ;
Ashraf, Imran .
KNOWLEDGE-BASED SYSTEMS, 2022, 255
[47]   SENTIMENT ANALYSIS OF PRODUCT REVIEWS IN THE ABSENCE OF LABELLED DATA USING SUPERVISED LEARNING APPROACHES [J].
Muhammad, Waqar ;
Mushtaq, Maria ;
Junejo, Khurum Nazir ;
Khan, Muhammad Yaseen .
MALAYSIAN JOURNAL OF COMPUTER SCIENCE, 2020, 33 (02) :118-132
[48]   Multi-Tier Sentiment Analysis of Social Media Text Using Supervised Machine Learning [J].
Rahman, Hameedur ;
Tariq, Junaid ;
Masood, M. Ali ;
Subahi, Ahmad F. ;
Khalaf, Osamah Ibrahim ;
Alotaibi, Youseef .
CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 74 (03) :5527-5543
[49]   Sentiment Analysis on GPT-4 with Comparative Models Using Twitter Data [J].
Ozel, Mustafa ;
Bozkurt, Ozlem Cetinkaya .
ACTA INFOLOGICA, 2024, 8 (01) :23-33
[50]   Twitter Sentiment Analysis with Different Feature Extractors and Dimensionality Reduction using Supervised Learning Algorithms [J].
Shyamasundar, L. B. ;
Rani, Jhansi P. .
2016 IEEE ANNUAL INDIA CONFERENCE (INDICON), 2016,