Improving Cross-Domain Aspect-Based Sentiment Analysis using Bert-BiLSTM Model and Dual Attention Mechanism

被引:0
作者
Xu, Yadi [1 ]
Ibrahim, Noor Farizah [1 ]
机构
[1] Univ Sains Malaysia, Sch Comp Sci, George Town 11800, Malaysia
来源
ADVANCES IN ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING | 2024年 / 4卷 / 03期
关键词
Aspect-based sentiment analysis; Cross-domain; BERT-BiLSTM; Dual Interaction Mechanism; ADAPTATION; EXTRACTION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data across different domains can be influenced by variations in language styles and expressions, making it challenging to migrate specialized words, particularly when focusing on aspectual words. This complexity poses difficulties in conducting cross-domain aspect- based sentiment analysis. The article begins by introducing BERT for generating word vectors as representations of training texts, enhancing text semantics in the word vector representation stage. To capture more nuanced interaction information and context-related details, the paper proposes the Bert-BiLSTM model with a dual attention mechanism(BBDAM), which divides the original input sequence into three parts: above, aspectual words, and below. A dual attention mechanism was used to assess the interaction of aspect words with the three aspects (above, below, and neighboring words) in the three discourse segments. This mechanism allows for the comprehensive extraction of interaction information. By comparing with other modeling approaches, the experimental results show that the BB-DAM model produces good results in fine-grained cross-domain sentiment analysis.
引用
收藏
页码:2468 / 2489
页数:22
相关论文
共 51 条
  • [1] Graph-Based Semantic Learning, Representation and Growth from Text: A Systematic Review
    Ali, Ismael
    Melton, Austin
    [J]. 2019 13TH IEEE INTERNATIONAL CONFERENCE ON SEMANTIC COMPUTING (ICSC), 2019, : 118 - 123
  • [2] LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT
    BENGIO, Y
    SIMARD, P
    FRASCONI, P
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02): : 157 - 166
  • [3] China Internet Network Information Center (CNNIC), 2022, The 49th Statistical Report on the Current Status of Internet Development in China
  • [4] Cui X, 2020, 1ST CONFERENCE OF THE ASIA-PACIFIC CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 10TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (AACL-IJCNLP 2020), P873
  • [5] KnowMIS-ABSA: an overview and a reference model for applications of sentiment analysis and aspect-based sentiment analysis
    D'Aniello, Giuseppe
    Gaeta, Matteo
    La Rocca, Ilaria
    [J]. ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (07) : 5543 - 5574
  • [6] Dai Y, 2020, AAAI CONF ARTIF INTE, V34, P7618
  • [7] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
  • [8] Use of Natural Language Processing (NLP) in Evaluation of Radiology Reports: An Update on Applications and Technology Advances
    Donnelly, Lane F.
    Grzeszczuk, Robert
    Guimaraes, Carolina, V
    [J]. SEMINARS IN ULTRASOUND CT AND MRI, 2022, 43 (02) : 176 - 181
  • [9] Learning multiple layers of knowledge representation for aspect based sentiment analysis
    Duc-Hong Pham
    Anh-Cuong Le
    [J]. DATA & KNOWLEDGE ENGINEERING, 2018, 114 : 26 - 39
  • [10] Feghali James, 2022, Acta Neurochir Suppl, V134, P221, DOI 10.1007/978-3-030-85292-4_26