A Neural Network Based on WXLNet and Multi-Task Lable Embedding for Sentiment Analysis

被引:0
作者
Xie, Chenxi [1 ]
Meng, Zhongvi [1 ]
Song, Bo [2 ,3 ]
Jiang, Guoping [2 ,3 ]
Song, Yurong [2 ,3 ]
机构
[1] Nanjing Univ Posts & Telecommun, Sch Comp Sci & Technol, Nanjing 210046, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Coll Automat, Nanjing 210046, Peoples R China
[3] Nanjing Univ Posts & Telecommun, Coll Artificial Intelligence, Nanjing 210046, Peoples R China
来源
PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021) | 2021年
基金
中国国家自然科学基金;
关键词
Natural Language Processing; Sentiment Analysis; WXLNet; MTLE; Deep Learning; Language Model;
D O I
10.1109/CCDC52312.2021.9601604
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sentiment analysis is an important field in natural language processing, the development of which has been greatly promoted by deep learning recently. However, previous studies focused on the structure of the model, and did not make full use of text semantics and label information. Moreover, the traditional model does not perform well in complex fine-grained sentiment classification. In this paper, we propose a new deep neural network model WXLNet-MTLE. By modifying XLNet language model, the utilization of text information and the language expression ability have been greatly improved. At the same time, we add Multi-Task Lable Embedding to improve the generalization ability of our model in its downstream sentiment analysis tasks. Comparative analysis are carried out on the data sets of 3 different tasks and 8 different scenarios. The experimental results show that WXLNet-MTLE performs better in sentiment analysis of multiple scenes than the other models.
引用
收藏
页码:2359 / 2366
页数:8
相关论文
共 22 条
  • [1] [Anonymous], 2018, P 27 INT C COMP LING
  • [2] [Anonymous], 2018, P 2018 C EMP METH NA
  • [3] Collobert R., 2008, P 25 INT C MACH LEAR, P160, DOI [DOI 10.1145/1390156.1390177, 10.1145/1390156.1390177]
  • [4] Dai ZH, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019), P2978
  • [5] dos Santos C., 2014, Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, P69, DOI DOI 10.1109/ICCAR.2017.7942788
  • [6] Hong Wei, 2019, COMPUTER ENG SCI, P751
  • [7] Liu P., 2016, P 25 INT JOINT C ART, V2016, P2873, DOI DOI 10.48550/ARXIV.1605.05101
  • [8] LIU X, 2015, REPRESENTATION LEARN, P91
  • [9] Mikolov T., 2013, Advances in Neural Information Processing Systems, V26
  • [10] Nguyen Thien Hai, 2015, PROC 2015 C EMPIRMET, P2509