Combining BERT and CNN for Sentiment Analysis A Case Study on COVID-19

被引:1
作者
Kumar, Gunjan [1 ]
Agrawal, Renuka [1 ]
Sharma, Kanhaiya [1 ]
Gundalwar, Pravin Ramesh [2 ]
Kazi, Aqsa [1 ]
Agrawal, Pratyush [3 ]
Tomar, Manjusha [4 ]
Salagrama, Shailaja [5 ]
机构
[1] Symbiosis Int, Symbiosis Inst Technol, Dept Comp Sci Engn, Pune, Maharashtra, India
[2] Anurag Univ, Dept Informat Technol, Hyderabad, India
[3] Symbiosis Int, Symbiosis Inst Technol, Dept Artificial Intelligence & Machine Learning, Pune, India
[4] Indira Coll Engn & Management, Basic Engn Dept, Pune, India
[5] Univ Cumberlands, Comp Informat Syst, Williamsburg, KY USA
关键词
Sentiment analysis; COVID-19; BERT; CNN; ensemble model; NLP; transfer learning;
D O I
10.14569/IJACSA.2024.0151069
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
research focuses on sentiment analysis to understand public opinion on various topics, with an emphasis on COVID-19 discussions on Twitter. By utilizing state-of-the-art Machine Learning (ML) and Natural Language Processing (NLP) techniques, the study analyzes sentiment data to provide valuable insights. The process begins with data preparation, involving text cleaning and length filtering to optimize the dataset for analysis. Two models are employed: a Bidirectional Encoder Representations from Transformers (BERT)-based Deep Learning (DL) model and a Convolutional Neural Network (CNN). The BERT model leverages transfer learning, demonstrating strong performance in sentiment classification, while the CNN model excels at extracting contextual features from the input text. To further enhance accuracy, an ensemble model integrates predictions from both approaches. The study emphasizes the ensemble technique's value for more precise sentiment analysis. Evaluation metrics, including accuracy, classification reports, and confusion matrices, validate the effectiveness of the proposed models and the ensemble approach. This research contributes to the growing field of social media sentiment analysis, particularly during global health crises like COVID-19, and underscores its potential to aid informed decision making based on public sentiment.
引用
收藏
页码:676 / 686
页数:11
相关论文
共 32 条
[1]  
Abu Kausar M, 2021, INT J ADV COMPUT SC, V12, P415
[2]   Transformer models for text-based emotion detection: a review of BERT-based approaches [J].
Acheampong, Francisca Adoma ;
Nunoo-Mensah, Henry ;
Chen, Wenyu .
ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (08) :5789-5829
[3]  
Agrawal Renuka, 2020, Computing in Engineering and Technology. Proceedings of ICCET 2019. Advances in Intelligent Systems and Computing (AISC 1025), P733, DOI 10.1007/978-981-32-9515-5_69
[4]   Challenges and Opportunities of Text-Based Emotion Detection: A Survey [J].
Al Maruf, Abdullah ;
Khanam, Fahima ;
Haque, Md. Mahmudul ;
Jiyad, Zakaria Masud ;
Mridha, M. F. ;
Aung, Zeyar .
IEEE ACCESS, 2024, 12 :18416-18450
[5]  
Alabid N.N., 2021, INDONES J ELECT ENG, V24, P1727, DOI [10.11591/ijeecs.v24.i3, DOI 10.11591/IJEECS.V24.I3.PP1727-1734]
[6]  
Ankit, 2018, Procedia Computer Science, V132, P937, DOI 10.1016/j.procs.2018.05.109
[7]   Machine Learning Techniques for Sentiment Analysis of COVID-19-Related Twitter Data [J].
Braig, Niklas ;
Benz, Alina ;
Voth, Soeren ;
Breitenbach, Johannes ;
Buettner, Ricardo .
IEEE ACCESS, 2023, 11 :14778-14803
[8]   Sentiment Analysis of COVID-19 tweets by Deep Learning Classifiers-A study to show how popularity is affecting accuracy in social media [J].
Chakraborty, Koyel ;
Bhatia, Surbhi ;
Bhattacharyya, Siddhartha ;
Platos, Jan ;
Bag, Rajib ;
Hassanien, Aboul Ella .
APPLIED SOFT COMPUTING, 2020, 97
[9]   Sentimental Analysis of COVID-19 Tweets Using Deep Learning Models [J].
Chintalapudi, Nalini ;
Battineni, Gopi ;
Amenta, Francesco .
INFECTIOUS DISEASE REPORTS, 2021, 13 (02) :329-339
[10]   Sentiment Analysis in Social Media and Its Application: Systematic Literature Review [J].
Drus, Zulfadzli ;
Khalid, Haliyana .
FIFTH INFORMATION SYSTEMS INTERNATIONAL CONFERENCE, 2019, 161 :707-714