Data Augmentation Using BERT-Based Models for Aspect-Based Sentiment Analysis

被引:0
|
作者
Hollander, Bron [1 ]
Frasincar, Flavius [1 ]
van der Knaap, Finn [1 ]
机构
[1] Erasmus Univ, Burgemeester Oudlaan 50, NL-3062 PA Rotterdam, Netherlands
来源
WEB ENGINEERING, ICWE 2024 | 2024年 / 14629卷
关键词
Aspect-based sentiment classification; Data augmentation; Neural network; Pre-trained language model;
D O I
10.1007/978-3-031-62362-2_8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In today's digital world, there is an overwhelming amount of opinionated data on the Web. However, effectively analyzing all available data proves to be a resource-intensive endeavor, requiring substantial time and financial investments to curate high-quality training datasets. To mitigate such problems, this paper compares data augmentation models for aspect-based sentiment analysis. Specifically, we analyze the effect of several BERT-based data augmentation methods on the performance of the state-of-the-art HAABSA++ model. We consider the following data augmentation models: EDA-adjusted (baseline), BERT, Conditional-BERT, BERTprepend, and BERTexpand. Our findings show that incorporating data augmentation techniques can significantly improve the out-of-sample accuracy of the HAABSA++ model. Specifically, our results highlight the effectiveness of BERTprepend and BERTexpand, increasing the test accuracy from 78.56% to 79.23% and from 82.62% to 84.47% for the SemEval 2015 and SemEval 2016 datasets, respectively.
引用
收藏
页码:115 / 122
页数:8
相关论文
共 50 条
  • [31] Aspect-based sentiment analysis using smart government review data
    Alqaryouti, Omar
    Siyam, Nur
    Monem, Azza Abdel
    Shaalan, Khaled
    APPLIED COMPUTING AND INFORMATICS, 2024, 20 (1/2) : 142 - 161
  • [32] Contrastive Learning-Based Cross-Domain Data Augmentation for Aspect-Based Sentiment Analysis
    Xue, Xiaoling
    Xu, Bin
    Dong, Xiaodi
    Cai, Qihang
    Gao, Kening
    WEB INFORMATION SYSTEMS AND APPLICATIONS, WISA 2024, 2024, 14883 : 180 - 188
  • [33] Leveraging hierarchical language models for aspect-based sentiment analysis on financial data
    Lengkeek, Matteo
    Knaap, Finn van der
    Frasincar, Flavius
    INFORMATION PROCESSING & MANAGEMENT, 2023, 60 (05)
  • [34] Sentiment Difficulty in Aspect-Based Sentiment Analysis
    Chifu, Adrian-Gabriel
    Fournier, Sebastien
    MATHEMATICS, 2023, 11 (22)
  • [35] Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence
    Sun, Chi
    Huang, Luyao
    Qiu, Xipeng
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 380 - 385
  • [36] Multi-Task Learning Model with Data Augmentation for Arabic Aspect-Based Sentiment Analysis
    Fadel, Arwa Saif
    Abulnaja, Osama Ahmed
    Saleh, Mostafa Elsayed
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 4419 - 4444
  • [37] Aspect-Based Sentiment Analysis of Patient Feedback Using Large Language Models
    Alkhnbashi, Omer S.
    Mohammad, Rasheed
    Hammoudeh, Mohammad
    BIG DATA AND COGNITIVE COMPUTING, 2024, 8 (12)
  • [38] Enhancing Arabic aspect-based sentiment analysis using deep learning models
    Al-Dabet, Saja
    Tedmori, Sara
    AL-Smadi, Mohammad
    COMPUTER SPEECH AND LANGUAGE, 2021, 69
  • [39] Text Augmentation Based on Integrated Gradients Attribute Score for Aspect-based Sentiment Analysis
    Santoso, Noviyanti
    Mendonca, Israel
    Aritsugi, Masayoshi
    2023 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING, BIGCOMP, 2023, : 227 - 234
  • [40] Aspect-based Sentiment Analysis using Dependency Parsing
    Rani, Sujata
    Kumar, Parteek
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2022, 21 (03)