Sentiment Analysis of Comment Data Based on BERT-ETextCNN-ELSTM

被引:6
作者
Deng, Lujuan [1 ]
Yin, Tiantian [1 ]
Li, Zuhe [1 ]
Ge, Qingxia [1 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Comp & Commun Engn, Zhengzhou 450002, Peoples R China
基金
中国国家自然科学基金;
关键词
sentiment analysis; BERT; long short-term memory; convolutional neural network; MODEL; CNN;
D O I
10.3390/electronics12132910
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid popularity and continuous development of social networks, users' communication and interaction through platforms such as microblogs and forums have become more and more frequent. The comment data on these platforms reflect users' opinions and sentiment tendencies, and sentiment analysis of comment data has become one of the hot spots and difficulties in current research. In this paper, we propose a BERT-ETextCNN-ELSTM (Bidirectional Encoder Representations from Transformers-Enhanced Convolution Neural Networks-Enhanced Long Short-Term Memory) model for sentiment analysis. The model takes text after word embedding and BERT encoder processing and feeds it to an optimized CNN layer for convolutional operations in order to extract local features of the text. The features from the CNN layer are then fed into the LSTM layer for time-series modeling to capture long-term dependencies in the text. The experimental results proved that compared with TextCNN (Convolution Neural Networks), LSTM (Long Short-Term Memory), TextCNN-LSTM (Convolution Neural Networks-Long Short-Term Memory), and BiLSTM-ATT (Bidirectional Long Short-Term Memory Network-Attention), the model proposed in this paper was more effective in sentiment analysis. In the experimental data, the model reached a maximum of 0.89, 0.88, and 0.86 in terms of accuracy, F1 value, and macro-average F1 value, respectively, on both datasets, proving that the model proposed in this paper was more effective in sentiment analysis of comment data. The proposed model achieved better performance in the review sentiment analysis task and significantly outperformed the other comparable models.
引用
收藏
页数:17
相关论文
共 34 条
[11]   Sentiment classification of microblog: A framework based on BERT and CNN with attention mechanism [J].
Jia, Keliang .
COMPUTERS & ELECTRICAL ENGINEERING, 2022, 101
[12]   Malware classification with Word2Vec, HMM2Vec, BERT, and ELMo [J].
Kale, Aparna Sunil ;
Pandya, Vinay ;
Di Troia, Fabio ;
Stamp, Mark .
JOURNAL OF COMPUTER VIROLOGY AND HACKING TECHNIQUES, 2023, 19 (01) :1-16
[13]  
Keliang Jia, 2020, 2020 International Conference on Computer Information and Big Data Applications (CIBDA). Proceedings, P309, DOI 10.1109/CIBDA50819.2020.00076
[14]   High accuracy offering attention mechanisms based deep learning approach using CNN/bi-LSTM for sentiment analysis [J].
Kota, Venkateswara Rao ;
Munisamy, Shyamala Devi .
INTERNATIONAL JOURNAL OF INTELLIGENT COMPUTING AND CYBERNETICS, 2022, 15 (01) :61-74
[15]  
Kumar A, 2018, 2018 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), P905, DOI 10.1109/SSCI.2018.8628865
[16]  
[李慧 Li Hui], 2019, [数据分析与知识发现, Data Analysis and Knowledge Discovery], V3, P95
[17]   A cognitive brain model for multimodal sentiment analysis based on attention neural networks [J].
Li, Yuanqing ;
Zhang, Ke ;
Wang, Jingyu ;
Gao, Xinbo .
NEUROCOMPUTING, 2021, 430 :159-173
[18]  
Licai Sun, 2020, MuSe'20: Proceedings of the 1st International Multimodal Sentiment Analysis in Real-life Media Challenge and Workshop, P27, DOI 10.1145/3423327.3423672
[19]   Sequence encoding incorporated CNN model for Email document sentiment classification [J].
Liu, Sisi ;
Lee, Ickjai .
APPLIED SOFT COMPUTING, 2021, 102
[20]  
Mao Hong, 2014, Journal of Chinese Computer Systems, V35, P811