Capsule Network-Based Text Sentiment Classification

被引:12
作者
Chen, Bingyang [1 ]
Xu, Zhidong [2 ]
Wang, Xiao [3 ,4 ]
Xu, Long [1 ]
Zhang, Weishan [1 ]
机构
[1] China Univ Petr, Sch Comp Sci & Technol, Qingdao 266580, Peoples R China
[2] Natl Def Univ PLA China, Sch Secur, Beijing 100091, Peoples R China
[3] Qingdao Acad Intelligent Ind, Qingdao 266109, Shandong, Peoples R China
[4] Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
关键词
Sentiment classification; Capsule network; Transformer; Deep learning; Attention;
D O I
10.1016/j.ifacol.2021.04.160
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To improve text sentiments classification issues, such as information loss and insensitivity to spatial information, this paper proposes a text sentiment classification model based on the capsule network (T-Caps), which uses the Transformer to extract low-level text features. The method iteratively updates capsule network parameters through optimized dynamic routing algorithms and global parameter sharing, and it obtains the relationship between local features of the text and the overall emotional polarity to save the information integrity of text features. By comparing with multiple models, we find that the Transformer has the strongest feature extraction capability. The experimental results show that our model is capable of extracting more discriminative semantic features and yields a significant performance gain compared to other baseline methods. Copyright (C) 2020 The Authors.
引用
收藏
页码:698 / 703
页数:6
相关论文
共 20 条
[1]  
[Anonymous], 2016, INT JOINT C ARTIFICI
[2]  
[Anonymous], 2014, C EMPIRICAL METHODS
[3]  
Bhatt A., 2015, International Journal of Computer Science and Information Technologies, V6, P5107
[4]  
Bingyang Chen, 2019, 2019 International Conference on Electronic Engineering and Informatics (EEI). Proceedings, P471, DOI 10.1109/EEI48997.2019.00108
[5]  
Cheng Yan, 2019, CHINESE J INFORM, V33, P133
[6]   Improving Chinese Sentiment Analysis via Segmentation-Based Representation Using Parallel CNN [J].
Hao, Yazhou ;
Zheng, Qinghua ;
Lan, Yangyang ;
Li, Yufei ;
Wang, Meng ;
Wang, Sen ;
Li, Chen .
ADVANCED DATA MINING AND APPLICATIONS, ADMA 2017, 2017, 10604 :668-680
[7]  
Kim S.-M., 2007, Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), P1056
[8]  
LI Hui, 2020, COMPUTER ENG APPL
[9]  
Li Z, 2018, AAAI CONF ARTIF INTE, P5852
[10]  
LIN Yue, 2019, J NANJING U INFORM S, V11, P286