Sentiment Analysis of Comment Data Based on BERT-ETextCNN-ELSTM

被引:6
作者
Deng, Lujuan [1 ]
Yin, Tiantian [1 ]
Li, Zuhe [1 ]
Ge, Qingxia [1 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Comp & Commun Engn, Zhengzhou 450002, Peoples R China
基金
中国国家自然科学基金;
关键词
sentiment analysis; BERT; long short-term memory; convolutional neural network; MODEL; CNN;
D O I
10.3390/electronics12132910
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid popularity and continuous development of social networks, users' communication and interaction through platforms such as microblogs and forums have become more and more frequent. The comment data on these platforms reflect users' opinions and sentiment tendencies, and sentiment analysis of comment data has become one of the hot spots and difficulties in current research. In this paper, we propose a BERT-ETextCNN-ELSTM (Bidirectional Encoder Representations from Transformers-Enhanced Convolution Neural Networks-Enhanced Long Short-Term Memory) model for sentiment analysis. The model takes text after word embedding and BERT encoder processing and feeds it to an optimized CNN layer for convolutional operations in order to extract local features of the text. The features from the CNN layer are then fed into the LSTM layer for time-series modeling to capture long-term dependencies in the text. The experimental results proved that compared with TextCNN (Convolution Neural Networks), LSTM (Long Short-Term Memory), TextCNN-LSTM (Convolution Neural Networks-Long Short-Term Memory), and BiLSTM-ATT (Bidirectional Long Short-Term Memory Network-Attention), the model proposed in this paper was more effective in sentiment analysis. In the experimental data, the model reached a maximum of 0.89, 0.88, and 0.86 in terms of accuracy, F1 value, and macro-average F1 value, respectively, on both datasets, proving that the model proposed in this paper was more effective in sentiment analysis of comment data. The proposed model achieved better performance in the review sentiment analysis task and significantly outperformed the other comparable models.
引用
收藏
页数:17
相关论文
共 34 条
[31]  
Yin WP, 2016, Arxiv, DOI arXiv:1603.04513
[32]   Detecting Malicious Web Requests Using an Enhanced TextCNN [J].
Yu, Lian ;
Chen, Lihao ;
Dong, Jingtao ;
Li, Mengyuan ;
Liu, Lijun ;
Zhao, Bai ;
Zhang, Chen .
2020 IEEE 44TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2020), 2020, :768-777
[33]   Anchored Model Transfer and Soft Instance Transfer for Cross-Task Cross-Domain Learning: A Study Through Aspect-Level Sentiment Classification [J].
Zheng, Yaowei ;
Zhang, Richong ;
Wang, Suyuchen ;
Mensah, Samuel ;
Mao, Yongyi .
WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, :2754-2760
[34]  
Zhou Q., 2018, P 9 WORKSHOP COMPUTA, P189, DOI DOI 10.18653/V1/W18-6226