A Context-focused Attention Evolution Model for Aspect-based Sentiment Classification

被引:0
作者
Deng, Xiaoheng [1 ]
Han, Dingjie [1 ]
Jiang, Ping [1 ]
机构
[1] Cent South Univ, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
Aspect-Based Sentiment Classification; masked language model; Bert;
D O I
10.1145/3587465
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to their inherent capability in the semantic alignment of aspects and their context words, Attention and Long-Short-Term-Memory (LSTM) mechanisms are widely adopted for Aspect-Based Sentiment Classification (ABSC) tasks. Instead, it is challenging to handle long-range word dependencies on multiple entities due to the deficiency in attention mechanisms. To solve this problem, we propose a Context-Focused Aspect-Based Network to align attention before LSTM, making the model focus more on aspect-related words and ignore irrelevant words, improving the accuracy of final classification. This can either alleviate attention distraction or reinforce the text representation ability. Experiments on two benchmark datasets show that the results achieve respectable performance compared to the state-of-the-art methods available in ABSC. Our approach has the potential to improve classification accuracy by adaptively adjusting the focus on context.
引用
收藏
页数:14
相关论文
共 42 条
[1]   Deep learning-based sentiment classification of evaluative text based on Multi-feature fusion [J].
Abdi, Asad ;
Shamsuddin, Siti Mariyam ;
Hasan, Shafaatunnur ;
Piran, Jalil .
INFORMATION PROCESSING & MANAGEMENT, 2019, 56 (04) :1245-1259
[2]  
[Anonymous], 2015, P 2015 C EMP METH NA, DOI [DOI 10.18653/V1/D15-1167, 10.18653/v1/D15-1167]
[3]  
[Anonymous], 2017, P 2017 C EMPIRICAL M, DOI [10.18653/v1/D17-1047, DOI 10.18653/V1/D17-1047]
[4]  
[Anonymous], 2010, Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, PMLR
[5]  
Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473,1409.0473, DOI 10.48550/ARXIV.1409.0473,1409.0473]
[6]  
Bo Pang, 2008, Foundations and Trends in Information Retrieval, V2, P1, DOI 10.1561/1500000001
[7]   Spider Monkey Crow Optimization Algorithm With Deep Learning for Sentiment Classification and Information Retrieval [J].
Chugh, Aarti ;
Sharma, Vivek Kumar ;
Kumar, Sandeep ;
Nayyar, Anand ;
Qureshi, Basit ;
Bhatia, Manjot Kaur ;
Jain, Charu .
IEEE ACCESS, 2021, 9 (09) :24249-24262
[8]  
Chung JY, 2015, PR MACH LEARN RES, V37, P2067
[9]   Sentiment Analysis Based on Deep Learning: A Comparative Study [J].
Dang, Nhan Cach ;
Moreno-Garcia, Maria N. ;
De la Prieta, Fernando .
ELECTRONICS, 2020, 9 (03)
[10]  
Devlin J, 2019, Arxiv, DOI [arXiv:1810.04805, 10.48550/arxiv.1810.04805]