Text Sentiment Analysis of Douban Film Short Comments Based on BERT-CNN-BiLSTM-Att Model

被引:17
作者
He, Aixiang [1 ,2 ]
Abisado, Mideth [1 ]
机构
[1] Natl Univ, Coll Comp & Informat Technol, Manila 1008, Philippines
[2] Anhui Xinhua Univ, Coll Big Data & Artificial Intelligence, Hefei 230088, Peoples R China
关键词
Feature extraction; Vectors; Analytical models; Semantics; Task analysis; Sentiment analysis; Convolutional neural networks; BERT-CNN-BiLSTM-Att; sentiment analysis; hybrid model; film short text reviews comments; TRANSFORMER;
D O I
10.1109/ACCESS.2024.3381515
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problems of polysemy and feature extraction in the text sentiment analysis process, a BERT-CNN-BiLSTM-Att hybrid model has been proposed for text sentiment analysis. The BERT pre-training model was established to break up the text input into words and obtain a dynamic word vector that was then input into the CNN and the BiLSTM models respectively. Later, the local features of the word vector, extracted using CNN, and the global features, extracted using BiLSTM, were fused, and the key information of the Douban movie review dataset was highlighted using the attention mechanism to realize sentiment categorization of the dataset. The results of comparison between the constructed model and Word2Vec-BiLSTM, Word2Vec-CNN, Word2Vec-CNN-BiLSTM-Att, BERT, BERT-CNN and BERT-BiLSTM models show that the model that runs against the test dataset has an increased accuracy by 4.63%,4.37%,3.64%,2.63%,2.56% and 5.54% respectively. The experimental findings reveal that BERT-CNN-BiLSTM-Att's sentiment analysis method is more accurate in performing sentiment classification.
引用
收藏
页码:45229 / 45237
页数:9
相关论文
共 26 条
[1]  
Azhar A. N., 2020, P INT C ADV INF CONC, DOI DOI 10.1109/ICAICTA49861.2020.9428882
[2]  
Baziotis C., 2017, P 11 INT WORKSH SEM, P747
[3]   Aspect based sentiment analysis using deep learning approaches: A survey [J].
Chauhan, Ganpat Singh ;
Nahta, Ravi ;
Meena, Yogesh Kumar ;
Gopalani, Dinesh .
COMPUTER SCIENCE REVIEW, 2023, 49
[4]  
Chen H., 2022, 2022 4 INT C COMM IN, P605, DOI [10.1109/CISCE55963.2022.9851054, DOI 10.1109/CISCE55963.2022.9851054]
[5]  
Chen Y., 2023, J. Chin. Acad. Electron. Sci., V18, P939
[6]   Text sentiment analysis of fusion model based on attention mechanism [J].
Deng, Hongjie ;
Ergu, Daji ;
Liu, Fangyao ;
Cai, Ying ;
Ma, Bo .
8TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT (ITQM 2020 & 2021): DEVELOPING GLOBAL DIGITAL ECONOMY AFTER COVID-19, 2022, 199 :741-748
[7]  
Fahmi M., 2023, PROC 8 INT C INFORMA, P1, DOI [10.1109/icic60109.2023.10381908, DOI 10.1109/ICIC60109.2023.10381908]
[8]  
Hassan A, 2017, 2017 3RD INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND ROBOTICS (ICCAR), P705, DOI 10.1109/ICCAR.2017.7942788
[9]  
Imron S., 2023, J RESTI REKAYASA SIS, DOI [10.29207/resti.v7i3.4751, DOI 10.29207/RESTI.V7I3.4751]
[10]  
Jia N., 2023, Chin. J. Appl. Sci., V41, P55, DOI [10.3969/j.issn.0255-8297.2023.01.005, DOI 10.3969/J.ISSN.0255-8297.2023.01.005]