Text Sentiment Analysis based on BERT and Convolutional Neural Networks

被引:4
|
作者
Huang, P. [1 ]
Zhu, H. J. [1 ]
Zheng, L. [1 ]
Wang, Y. [1 ]
机构
[1] Nanjing Univ Sci & Technol, ZiJin Coll, Nanjing, Peoples R China
来源
2021 5TH INTERNATIONAL CONFERENCE ON NATURAL LANGUAGE PROCESSING AND INFORMATION RETRIEVAL, NLPIR 2021 | 2021年
关键词
BERT; Word embedding; Sentiment analysis; Convolutional Neural Networks; ATTENTION;
D O I
10.1145/3508230.3508231
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The rapid development of the network has accelerated the speed of information circulation. Analyzing the emotional tendency contained in the network text is very helpful to tap the needs of users. However, most of the existing sentiment classification models rely on manually labeled text features, resulting in insufficient mining of deep semantic features hidden in the text, and it is difficult to improve the classification performance significantly. This paper presents a text sentiment classification model combining BERT and convolutional neural networks (CNN). The model uses BERT to complete the word embedding of the text, and then uses CNN to learn the deep semantic information about the text, so as mine the emotional tendency towards the text. Through verification on the large movie review dataset, BERT-CNN model can achieve an accuracy of 86.67%, which is significantly better than traditional classification method of textCNN. The results show that the method has good performance in this field.
引用
收藏
页码:1 / 7
页数:7
相关论文
共 50 条
  • [1] Persian Text Sentiment Analysis Based on BERT and Neural Networks
    Siroos Rahmani Zardak
    Amir Hossein Rasekh
    Mohammad Sadegh Bashkari
    Iranian Journal of Science and Technology, Transactions of Electrical Engineering, 2023, 47 : 1623 - 1634
  • [2] Persian Text Sentiment Analysis Based on BERT and Neural Networks
    Zardak, Siroos Rahmani
    Rasekh, Amir Hossein
    Bashkari, Mohammad Sadegh
    IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY-TRANSACTIONS OF ELECTRICAL ENGINEERING, 2023, 47 (04) : 1623 - 1634
  • [3] Chinese Text Sentiment Analysis Based on Improved Convolutional Neural Networks
    Lin, Xing
    Han, Chunyan
    PROCEEDINGS OF 2018 IEEE 9TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2018, : 296 - 300
  • [4] Chinese Text Sentiment Analysis Based on Improved Convolutional Neural Networks
    Xiao, Kecong
    Zhang, Zishuai
    Wu, Jun
    PROCEEDINGS OF 2016 IEEE 7TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2016), 2016, : 922 - 926
  • [5] Investigation on the Chinese Text Sentiment Analysis Based on Convolutional Neural Networks in Deep Learning
    Xu, Feng
    Zhang, Xuefen
    Xin, Zhanhong
    Yang, Alan
    CMC-COMPUTERS MATERIALS & CONTINUA, 2019, 58 (03): : 697 - 709
  • [6] Short text sentiment analysis based on convolutional neural network
    Li, Weisen
    Li, Zhiqing
    Fang, Xupeng
    2018 14TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS (WIMOB 2018), 2018, : 291 - 295
  • [7] BERT-based combination of convolutional and recurrent neural network for indonesian sentiment analysis
    Murfi, Hendri
    Syamsyuriani
    Gowandi, Theresia
    Ardaneswari, Gianinna
    Nurrohmah, Siti
    APPLIED SOFT COMPUTING, 2024, 151
  • [8] Text sentiment analysis based on BERT-CBLBGA
    Jia, Keliang
    Meng, Fanxu
    Liang, Jing
    Gong, Pimei
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 112
  • [9] A fuzzy convolutional neural network for text sentiment analysis
    Tuan-Linh Nguyen
    Kavuri, Swathi
    Lee, Minho
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 35 (06) : 6025 - 6034
  • [10] Convolutional Neural Networks for Multimedia Sentiment Analysis
    Cai, Guoyong
    Xia, Binbin
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2015, 2015, 9362 : 159 - 167