Sentiment Analysis of Comment Data Based on BERT-ETextCNN-ELSTM

被引:6
作者
Deng, Lujuan [1 ]
Yin, Tiantian [1 ]
Li, Zuhe [1 ]
Ge, Qingxia [1 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Comp & Commun Engn, Zhengzhou 450002, Peoples R China
基金
中国国家自然科学基金;
关键词
sentiment analysis; BERT; long short-term memory; convolutional neural network; MODEL; CNN;
D O I
10.3390/electronics12132910
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid popularity and continuous development of social networks, users' communication and interaction through platforms such as microblogs and forums have become more and more frequent. The comment data on these platforms reflect users' opinions and sentiment tendencies, and sentiment analysis of comment data has become one of the hot spots and difficulties in current research. In this paper, we propose a BERT-ETextCNN-ELSTM (Bidirectional Encoder Representations from Transformers-Enhanced Convolution Neural Networks-Enhanced Long Short-Term Memory) model for sentiment analysis. The model takes text after word embedding and BERT encoder processing and feeds it to an optimized CNN layer for convolutional operations in order to extract local features of the text. The features from the CNN layer are then fed into the LSTM layer for time-series modeling to capture long-term dependencies in the text. The experimental results proved that compared with TextCNN (Convolution Neural Networks), LSTM (Long Short-Term Memory), TextCNN-LSTM (Convolution Neural Networks-Long Short-Term Memory), and BiLSTM-ATT (Bidirectional Long Short-Term Memory Network-Attention), the model proposed in this paper was more effective in sentiment analysis. In the experimental data, the model reached a maximum of 0.89, 0.88, and 0.86 in terms of accuracy, F1 value, and macro-average F1 value, respectively, on both datasets, proving that the model proposed in this paper was more effective in sentiment analysis of comment data. The proposed model achieved better performance in the review sentiment analysis task and significantly outperformed the other comparable models.
引用
收藏
页数:17
相关论文
共 34 条
[1]  
Alhagry S, 2017, INT J ADV COMPUT SC, V8, P355, DOI 10.14569/IJACSA.2017.081046
[2]  
[Anonymous], 2011, Proceedings of the 20th ACM international conference on Information and knowledge management, CIKM'11
[3]  
Banupriya R., 2020, NEUROQUANTOLOGY, V18, P1, DOI 10.14704/nq.2020.18.7.nq20185
[4]  
Bengio Y, 2001, ADV NEUR IN, V13, P932
[5]   A Survey on Aspect-Based Sentiment Classification [J].
Brauwers, Gianni ;
Frasincar, Flavius .
ACM COMPUTING SURVEYS, 2023, 55 (04)
[6]  
Chen Y, 2015, CONVOLUTIONAL NEURAL
[7]   Sentiment Analysis Using Multi-Head Attention Capsules With Multi-Channel CNN and Bidirectional GRU [J].
Cheng, Yan ;
Sun, Huan ;
Chen, Haomai ;
Li, Meng ;
Cai, Yingying ;
Cai, Zhuang ;
Huang, Jing .
IEEE ACCESS, 2021, 9 :60383-60395
[8]   Application of Long Short-Term Memory (LSTM) on the Prediction of Rainfall-Runoff in Karst Area [J].
Fang, Longzhang ;
Shao, Dongguo .
FRONTIERS IN PHYSICS, 2022, 9
[9]  
Febrian Rio, 2023, Procedia Computer Science, P39, DOI 10.1016/j.procs.2022.12.109
[10]   Targeted aspect-based emotion analysis to detect opportunities and precaution in financial Twitter messages [J].
Garcia-Mendez, Silvia ;
de Arriba-Perez, Francisco ;
Barros-Vila, Ana ;
Gonzalez-Castano, Francisco J. .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 218