Knowledge-guided multi-granularity GCN for ABSA

被引:50
作者
Zhu, Zhenfang [1 ]
Zhang, Dianyuan [1 ]
Li, Lin [2 ]
Li, Kefeng [1 ]
Qi, Jiangtao [1 ]
Wang, Wenling [3 ]
Zhang, Guangyuan [1 ]
Liu, Peiyu [4 ]
机构
[1] Shandong Jiao Tong Univ, Sch Informat Sci & Elect Engn, Jinan 250357, Peoples R China
[2] Wuhan Univ Technol, Sch Comp & Artificial Intelligence, Wuhan 430070, Peoples R China
[3] Lu Dong Univ, Chinese Lexicog Res Ctr, Yantai 264025, Peoples R China
[4] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250358, Peoples R China
关键词
Sentiment analysis; Graph neural network; Conceptual knowledge; Robustness analysis; Attention mechanism;
D O I
10.1016/j.ipm.2022.103223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aspect-based sentiment analysis aims to determine sentiment polarities toward specific aspect terms within the same sentence or document. Most recent studies adopted attention-based neural network models to implicitly connect aspect terms with context words. However, these studies were limited by insufficient interaction between aspect terms and opinion words, leading to poor performance on robustness test sets. In addition, we have found that robustness test sets create new sentences that interfere with the original information of a sentence, which often makes the text too long and leads to the problem of long-distance dependence. Simultaneously, these new sentences produce more non-target aspect terms, misleading the model because of the lack of relevant knowledge guidance. This study proposes a knowledge guided multi-granularity graph convolutional neural network (KMGCN) to solve these problems. The multi-granularity attention mechanism is designed to enhance the interaction between aspect terms and opinion words. To address the long-distance dependence, KMGCN uses a graph convolutional network that relies on a semantic map based on fine-tuning pre-trained models. In particular, KMGCN uses a mask mechanism guided by conceptual knowledge to encounter more aspect terms (including target and non-target aspect terms). Experiments are conducted on 12 SemEval-2014 variant benchmarking datasets, and the results demonstrated the effectiveness of the proposed framework.
引用
收藏
页数:15
相关论文
共 48 条
[1]  
Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473, DOI 10.48550/ARXIV.1409.0473]
[2]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[3]  
Dai JQ, 2021, 2021 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL-HLT 2021), P1816
[4]  
Davidson J, 2010, P 4 ACM C REC SYST, P293, DOI [DOI 10.1145/1864708.1864770, 10.1145/1864708.1864770]
[5]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[6]  
Dong L, 2015, PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, P260
[7]  
Fan FF, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P3433
[8]   Fast and Accurate Annotation of Short Texts with Wikipedia Pages [J].
Ferragina, Paolo ;
Scaiella, Ugo .
IEEE SOFTWARE, 2012, 29 (01) :70-75
[9]  
Ferragina Paolo, 2010, P 19 ACM INT C INFOR, P1625
[10]  
Gao TY, 2021, 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), P6894