Aspect-based sentiment analysis with component focusing multi-head co-attention networks

被引:28
作者
Cheng, Li-Chen [1 ]
Chen, Yen-Liang [2 ]
Liao, Yuan-Yu [2 ]
机构
[1] Natl Taipei Univ Technol, Dept Informat & Finance Management, Taipei 100, Taiwan
[2] Natl Cent Univ, Chungli 320, Taiwan
关键词
Deep learning; Neural network; Sentiment analysis; BERT;
D O I
10.1016/j.neucom.2022.03.027
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
User-generated content based on customer opinions and experience has become a rich source of valuable information for enterprises. The purpose of aspect-based sentiment analysis is to predict the sentiment polarity of specific targets from user-generated content. This study proposes a component focusing multi-head co-attention network model which contains three modules: extended context, component focusing, and multi-headed co-attention, designed to improve upon problems encountered in the past. The extended context module improves the ability of bidirectional encoder representations from trans-formers to handle aspect-based sentiment analysis tasks, and the component focusing module improves the weighting of adjectives and adverbs, to alleviate the problem of average pooling, which treats every word as an equally important term. The multi-head co-attention network is applied to learn the impor-tant words in a multi-word target before acquiring the context representation and performs the attention mechanism on the sequence data. The performance of the proposed model is evaluated in extensive experiments on publicly available datasets. The results show that the performance of the proposed model is better than that of the recent state-of-the-art models.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:9 / 17
页数:9
相关论文
共 45 条
  • [1] [Anonymous], 2014, ICLR 15
  • [2] ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis
    Basiri, Mohammad Ehsan
    Nemati, Shahla
    Abdar, Moloud
    Cambria, Erik
    Acharya, U. Rajendra
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 115 : 279 - 294
  • [3] Cambria E, 2017, SOCIO AFFECT COMPUT, V5, P1, DOI 10.1007/978-3-319-55394-8
  • [4] SenticNet 6: Ensemble Application of Symbolic and Subsymbolic AI for Sentiment Analysis
    Cambria, Erik
    Li, Yang
    Xing, Frank Z.
    Poria, Soujanya
    Kwok, Kenneth
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 105 - 114
  • [5] Cambria E, 2017, SOCIO AFFECT COMPUT, V5, P1, DOI 10.1007/978-3-319-55394-8_1
  • [6] Affective Computing and Sentiment Analysis
    Cambria, Erik
    [J]. IEEE INTELLIGENT SYSTEMS, 2016, 31 (02) : 102 - 107
  • [7] Chen P., 2017, P 2017 C EMPIRICAL M, P452, DOI [10.18653/v1/D17-1047, DOI 10.18653/V1/D17-1047]
  • [8] User-Defined SWOT analysis-A change mining perspective on user-generated content
    Cheng, Li-Chen
    Chen, Kuanchin
    Lee, Ming-Chu
    Li, Kua-Mai
    [J]. INFORMATION PROCESSING & MANAGEMENT, 2021, 58 (05)
  • [9] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
  • [10] Dong L, 2014, PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, P49