Multi-head self-attention based gated graph convolutional networks for aspect-based sentiment classification

被引:0
作者
Luwei Xiao
Xiaohui Hu
Yinong Chen
Yun Xue
Bingliang Chen
Donghong Gu
Bixia Tang
机构
[1] South China Normal University,Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials, GPETR Center for Quantum Precision Measurement, SPTE, School of Physics and Telecommunication Engineering
[2] Arizona State University,School of Computing, Informatics, and Decision Systems Engineering
来源
Multimedia Tools and Applications | 2022年 / 81卷
关键词
Aspect-based sentiment classification; Multi-head Self-Attention; Gated graph convolutional networks; Syntax-aware Context Dynamic Weighted;
D O I
暂无
中图分类号
学科分类号
摘要
Aspect-based sentiment classification aims to predict the sentiment polarity of specific aspects appeared in a sentence. Nowadays, most current methods mainly focus on the semantic information by exploiting traditional attention mechanisms combined with recurrent neural networks to capture the interaction between the contexts and the targets. However, these models did not consider the importance of the relevant syntactical constraints. In this paper, we propose to employ a novel gated graph convolutional networks on the dependency tree to encode syntactical information, and we design a Syntax-aware Context Dynamic Weighted layer to guide our model to pay more attention to the local syntax-aware context. Moreover, Multi-head Attention is utilized for capturing both semantic information and interactive information between semantics and syntax. We conducted experiments on five datasets and the results demonstrate the effectiveness of the proposed model.
引用
收藏
页码:19051 / 19070
页数:19
相关论文
共 30 条
[1]  
Bo P(2008)Opinion mining and sentiment analysis Found Trends Inf Ret 2 1-135
[2]  
Lee L(2008)Opinion mining and sentiment analysis Found Trends Inf Ret 2 1-135
[3]  
Bo P(2011)Natural language processing (almost) from scratch J Mach Learn Res 12 2493-2537
[4]  
Lee L(2018)Deep visual attention prediction[J] IEEE Trans Image Process 27 2368-2378
[5]  
Collobert R(2019)A deep network solution for attention and aesthetics aware photo cropping[J] IEEE Trans Pattern Anal Mach Intell 41 1531-1544
[6]  
Weston J(2020)Targeted sentiment classification based on attentional encoding and graph convolutional networks Appl. Sci. 10 957-1293
[7]  
Bottou L(2020)Pixel-level remote sensing image recognition based on bidirectional word vectors[J] IEEE Trans Geosci Remote Sens 58 1281-undefined
[8]  
Karlen M(2019)LCF: A local context focus mechanism for aspect-based sentiment classification Appl Sci 9 3389-undefined
[9]  
Kavukcuoglu K(undefined)undefined undefined undefined undefined-undefined
[10]  
Kuksa PP(undefined)undefined undefined undefined undefined-undefined