Lightweight multilayer interactive attention network for aspect-based sentiment analysis

被引:8
作者
Zheng, Wenjun [1 ]
Zhang, Shunxiang [2 ,4 ]
Yang, Cheng [3 ]
Hu, Peng [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Artificial Intelligence, Huainan, Peoples R China
[2] Anhui Univ Sci & Technol, Sch Comp Sci & Engn, Huainan, Peoples R China
[3] Zhejiang Gongshang Univ, Sch Comp & Informat Engn, Hangzhou, Peoples R China
[4] Hefei Comprehens Natl Sci Ctr, Artif Intelligence Res Inst, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
Sentiment analysis; deep learning; interactive learning; attention networks; CLASSIFICATION;
D O I
10.1080/09540091.2023.2189119
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aspect-based sentiment analysis (ABSA) aims to automatically identify the sentiment polarity of specific aspect words in a given sentence or document. Existing studies have recognised the value of interactive learning in ABSA and have developed various methods to precisely model aspect words and their contexts through interactive learning. However, these methods mostly take a shallow interactive way to model aspect words and their contexts, which may lead to the lack of complex sentiment information. To solve this issue, we propose a Lightweight Multilayer Interactive Attention Network (LMIAN) for ABSA. Specifically, we first employ a pre-trained language model to initialise word embedding vectors. Second, an interactive computational layer is designed to build correlations between aspect words and their contexts. Such correlation degree is calculated by multiple computational layers with neural attention models. Third, we use a parameter-sharing strategy among the computational layers. This allows the model to learn complex sentiment features with lower memory costs. Finally, LMIAN conducts instance validation on six publicly available sentiment analysis datasets. Extensive experiments show that LMIAN performs better than other advanced methods with relatively low memory consumption.
引用
收藏
页数:16
相关论文
共 41 条
[1]   A Survey on Aspect-Based Sentiment Classification [J].
Brauwers, Gianni ;
Frasincar, Flavius .
ACM COMPUTING SURVEYS, 2023, 55 (04)
[2]   Sentence Compression for Aspect-Based Sentiment Analysis [J].
Che, Wanxiang ;
Zhao, Yanyan ;
Guo, Honglei ;
Su, Zhong ;
Liu, Ting .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2015, 23 (12) :2111-2124
[3]  
Chen P., 2017, P 2017 C EMP METH NA, P452, DOI [10.18653/v1/D17-1047, DOI 10.18653/V1/D17-1047]
[4]   Memory network with hierarchical multi-head attention for aspect-based sentiment analysis [J].
Chen, Yuzhong ;
Zhuang, Tianhao ;
Guo, Kun .
APPLIED INTELLIGENCE, 2021, 51 (07) :4287-4304
[5]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[6]  
Dong L, 2014, PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, P49
[7]   APPROXIMATION OF DYNAMICAL-SYSTEMS BY CONTINUOUS-TIME RECURRENT NEURAL NETWORKS [J].
FUNAHASHI, K ;
NAKAMURA, Y .
NEURAL NETWORKS, 1993, 6 (06) :801-806
[8]  
Glorot X., 2010, PROC 13 INT C ARTIF, P249
[9]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[10]   Aspect Level Sentiment Classification with Attention-over-Attention Neural Networks [J].
Huang, Binxuan ;
Ou, Yanglan ;
Carley, Kathleen M. .
SOCIAL, CULTURAL, AND BEHAVIORAL MODELING, SBP-BRIMS 2018, 2018, 10899 :197-206