Opinion Mining and Analysis Using Hybrid Deep Neural Networks

被引:0
作者
Hidri, Adel [1 ]
Alsaif, Suleiman Ali [1 ]
Alahmari, Muteeb [1 ]
AlShehri, Eman [1 ]
Hidri, Minyar Sassi [1 ]
机构
[1] Imam Abdulrahman Bin Faisal Univ, Comp Dept, Deanship Preparatory Year & Supporting Studies, POB 1982, Dammam 31441, Saudi Arabia
关键词
bidirectional GRU; class imbalance; deep learning; opinion mining; sentiment analysis;
D O I
10.3390/technologies13050175
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Understanding customer attitudes has become a critical component of decision-making due to the growing influence of social media and e-commerce. Text-based opinions are the most structured, hence playing an important role in sentiment analysis. Most of the existing methods, which include lexicon-based approaches and traditional machine learning techniques, are insufficient for handling contextual nuances and scalability. While the latter has limitations in model performance and generalization, deep learning (DL) has achieved improvement, especially on semantic relationship capturing with recurrent neural networks (RNNs) and convolutional neural networks (CNNs). The aim of the study is to enhance opinion mining by introducing a hybrid deep neural network model that combines a bidirectional gated recurrent unit (BGRU) and long short-term memory (LSTM) layers to improve sentiment analysis, particularly addressing challenges such as contextual nuance, scalability, and class imbalance. To substantiate the efficacy of the proposed model, we conducted comprehensive experiments utilizing benchmark datasets, encompassing IMDB movie critiques and Amazon product evaluations. The introduced hybrid BGRU-LSTM (HBGRU-LSTM) architecture attained a testing accuracy of 95%, exceeding the performance of traditional DL frameworks such as LSTM (93.06%), CNN+LSTM (93.31%), and GRU+LSTM (92.20%). Moreover, our model exhibited a noteworthy enhancement in recall for negative sentiments, escalating from 86% (unbalanced dataset) to 96% (balanced dataset), thereby ensuring a more equitable and just sentiment classification. Furthermore, the model diminished misclassification loss from 20.24% for unbalanced to 13.3% for balanced dataset, signifying enhanced generalization and resilience.
引用
收藏
页数:22
相关论文
共 43 条
[1]  
Alnahas Dima., 2022 3rd International Informatics and Software Engineering Conference (IISEC) (Dec. 15, P1, DOI DOI 10.1109/IISEC56263.2022.9998264
[2]  
Anwar K., 2024, P 15 INT C COMP COMM, P1, DOI [10.1109/icccnt61001.2024.10726197, DOI 10.1109/ICCCNT61001.2024.10726197]
[3]  
Arumugam S.-R., 2022, Convergence Deep Learning Cyber-IoT System Security, DOI [10.1002/9781119857686.ch2, DOI 10.1002/9781119857686.CH2]
[4]  
Baccianella S, 2010, LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION
[5]  
Bavakhani M, 2019, 2019 5TH INTERNATIONAL CONFERENCE ON WEB RESEARCH (ICWR), P276, DOI 10.1109/ICWR.2019.8765282
[6]  
Choudhari Poonam, 2020, Machine Learning and Information Processing. Proceedings of ICMLIP 2019. Advances in Intelligent Systems and Computing (AISC 1101), P69, DOI 10.1007/978-981-15-1884-3_7
[7]   A Deep-Learned Embedding Technique for Categorical Features Encoding [J].
Dahouda, Mwamba Kasongo ;
Joe, Inwhee .
IEEE ACCESS, 2021, 9 :114381-114391
[8]  
Dubey Gaurav, 2016, International Journal of Data Analysis Techniques and Strategies, V8, P122
[9]  
Ejaz A, 2017, INT CONF INF COMMUN, P173, DOI 10.1109/ICICT.2017.8320185
[10]  
ElMassry A.-M., 2024, P IEEE 14 INT C CONT, P18, DOI [10.1109/ICCSCE61582.2024.10695972, DOI 10.1109/ICCSCE61582.2024.10695972]