Multi-Task Learning Model Based on BERT and Knowledge Graph for Aspect-Based Sentiment Analysis

被引:14
作者
He, Zhu [1 ]
Wang, Honglei [1 ,2 ]
Zhang, Xiaoping [3 ]
机构
[1] Guizhou Univ, Sch Elect Engn, Guiyang 550025, Peoples R China
[2] Key Lab Internet Collaborat Intelligent Mfg Guizho, Guiyang 550025, Peoples R China
[3] Sci & Technol Dept Guizhou Prov, Guiyang 550000, Peoples R China
关键词
aspect-based sentiment analysis; BERT encoder; knowledge graph; multi-task learning model; ATTENTION; CLASSIFICATION;
D O I
10.3390/electronics12030737
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aspect-based sentiment analysis (ABSA) aims to identify the sentiment of an aspect in a given sentence and thus can provide people with comprehensive information. However, many conventional methods need help to discover the linguistic knowledge implicit in sentences. Additionally, they are susceptible to unrelated words. To improve the performance of the model in the ABSA task, a multi-task sentiment analysis model based on Bidirectional Encoder Representation from Transformers (BERT) and a Knowledge Graph (SABKG) is proposed in this paper. Expressly, part-of-speech information is incorporated into the output representation of BERT, thereby obtaining textual semantic information through linguistic knowledge. It also enhances the textual representation to identify the aspect terms. Moreover, this paper constructs a knowledge graph of aspect and sentiment words. It uses a graph neural network to learn the embeddings in the triplet of "aspect word, sentiment polarity, sentiment word". The constructed graph improves the contextual relationship between the text's aspect and sentiment words. The experimental results on three open datasets show that the proposed model can achieve the most advanced performance compared with previous models.
引用
收藏
页数:16
相关论文
共 41 条
[1]  
Bao LX, 2019, 57TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2019:): STUDENT RESEARCH WORKSHOP, P253
[2]   ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis [J].
Basiri, Mohammad Ehsan ;
Nemati, Shahla ;
Abdar, Moloud ;
Cambria, Erik ;
Acharya, U. Rajendra .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 115 :279-294
[3]   A Multitask Multiview Neural Network for End-to-End Aspect-Based Sentiment Analysis [J].
Bie, Yong ;
Yang, Yan .
BIG DATA MINING AND ANALYTICS, 2021, 4 (03) :195-207
[4]   SenticNet 6: Ensemble Application of Symbolic and Subsymbolic AI for Sentiment Analysis [J].
Cambria, Erik ;
Li, Yang ;
Xing, Frank Z. ;
Poria, Soujanya ;
Kwok, Kenneth .
CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, :105-114
[5]   Embedding Both Finite and Infinite Communities on Graphs [J].
Cavallari, Sandro ;
Cambria, Erik ;
Cai, Hongyun ;
Chang, Kevin Chen-Chuan ;
Zheng, Vincent W. .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2019, 14 (03) :39-50
[6]   Knowledge-enhanced neural networks for sentiment analysis of Chinese reviews [J].
Chen, Fang ;
Huang, Yongfeng .
NEUROCOMPUTING, 2019, 368 :51-58
[7]  
Chen Z, 2020, 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), P3685
[8]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[9]  
Du CN, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P5489
[10]   Unsupervised word-level affect analysis and propagation in a lexical knowledge graph [J].
Fares, Mireille ;
Moufarrej, Angela ;
Jreij, Eliane ;
Tekli, Joe ;
Grosky, William .
KNOWLEDGE-BASED SYSTEMS, 2019, 165 :432-459