Chinese Text Sentiment Analysis Based on Dual Channel Attention Network with Hybrid Word Embedding

被引:0
|
作者
Zhou N. [1 ]
Zhong N. [1 ]
Jin G. [1 ]
Liu B. [1 ]
机构
[1] School of Electronic and Information Engineering, Lanzhou Jiaotong University, Lanzhou
基金
中国国家自然科学基金;
关键词
Attention Mechanism; Dynamic Word Vector; Rough Data Reasoning; Text Sentiment Analysis;
D O I
10.11925/infotech.2096-3467.2022.0332
中图分类号
学科分类号
摘要
[Objective] This paper addresses the challenges facing the traditional static word vector embedding method, aiming to handle polysemy in Chinese texts effectively. It also excavates the contextual emotional features and internal semantic association structure. [Methods] In one channel, we integrated the sentiment elements related to the text into Word2Vec and FastText word vectors through rough data reasoning. We also used CNN to extract the local features of the text. In the other channel, we employed BERT for word embedding supplement and used BiLSTM to obtain the global features of the texts. Finally, we added the attention calculation module for the deep interaction of dual channel features. [Results] The experiment on three Chinese datasets achieved the highest accuracy of 92.43%, representing an improvement of 0.81% over the best value of the benchmark model. [Limitations] The selected datasets are only for modelling coarse-grained sentiment classification. We did not conduct experiments in the fine-grained domain. [Conclusions] The proposed model could effectively improve the performance of Chinese text sentiment classification. © 2023 The Author(s).
引用
收藏
页码:58 / 68
页数:10
相关论文
共 30 条
  • [1] Hearst M A., Direction-Based Text Interpretation as an Information Access Refinement, Text-Based Intelligent Systems: Current Research and Practice in Information Extraction and Retrieval, pp. 257-274, (1992)
  • [2] Xie R B, Yuan X C, Liu Z Y, Et al., Lexical Sememe Prediction via Word Embeddings and Matrix Factorization, Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp. 4200-4206, (2017)
  • [3] Pang B, Lee L, Vaithyanathan S., Thumbs up? Sentiment Classification Using Machine Learning Techniques, Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, pp. 79-86, (2002)
  • [4] Chen Zhao, Xu Ruifeng, Gui Lin, Et al., Combining Convolutional Neural Networks and Word Sentiment Sequence Features for Chinese Text Sentiment Analysis, Journal of Chinese Information Processing, 29, 6, pp. 172-178, (2015)
  • [5] Lu W J, Duan Y, Song Y T., Self-Attention-Based Convolutional Neural Networks for Sentence Classification, Proceedings of the 6th International Conference on Computer and Communications, pp. 2065-2069, (2021)
  • [6] Mikolov T, Chen K, Corrado G, Et al., Efficient Estimation of Word Representations in Vector Space
  • [7] Pennington J, Socher R, Manning C., GloVe: Global Vectors for Word Representation, Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp. 1532-1543, (2014)
  • [8] Bojanowski P, Grave E, Joulin A, Et al., Enriching Word Vectors with Subword Information, Transactions of the Association for Computational Linguistics, 5, pp. 135-146, (2017)
  • [9] Choi J, Lee S W., Improving FastText with Inverse Document Frequency of Subwords, Pattern Recognition Letters, 133, pp. 165-172, (2020)
  • [10] Kim Y., Convolutional Neural Networks for Sentence Classification[C], Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pp. 1746-1751, (2014)