Data Augmentation Using BERT-Based Models for Aspect-Based Sentiment Analysis

被引:0
|
作者
Hollander, Bron [1 ]
Frasincar, Flavius [1 ]
van der Knaap, Finn [1 ]
机构
[1] Erasmus Univ, Burgemeester Oudlaan 50, NL-3062 PA Rotterdam, Netherlands
来源
WEB ENGINEERING, ICWE 2024 | 2024年 / 14629卷
关键词
Aspect-based sentiment classification; Data augmentation; Neural network; Pre-trained language model;
D O I
10.1007/978-3-031-62362-2_8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In today's digital world, there is an overwhelming amount of opinionated data on the Web. However, effectively analyzing all available data proves to be a resource-intensive endeavor, requiring substantial time and financial investments to curate high-quality training datasets. To mitigate such problems, this paper compares data augmentation models for aspect-based sentiment analysis. Specifically, we analyze the effect of several BERT-based data augmentation methods on the performance of the state-of-the-art HAABSA++ model. We consider the following data augmentation models: EDA-adjusted (baseline), BERT, Conditional-BERT, BERTprepend, and BERTexpand. Our findings show that incorporating data augmentation techniques can significantly improve the out-of-sample accuracy of the HAABSA++ model. Specifically, our results highlight the effectiveness of BERTprepend and BERTexpand, increasing the test accuracy from 78.56% to 79.23% and from 82.62% to 84.47% for the SemEval 2015 and SemEval 2016 datasets, respectively.
引用
收藏
页码:115 / 122
页数:8
相关论文
共 50 条
  • [1] Aspect-Based Subjectivity Analysis Using a BERT-based Approach
    Ng, Hu
    Chong, Wing Kin
    Chia, Yu Zhang
    Yap, Timothy Tzen Vun
    Goh, Vik Tor
    Wong, Lai Kuan
    Tan, Ian Kim Teck
    Cher, Dong Theng
    2024 IEEE 14TH SYMPOSIUM ON COMPUTER APPLICATIONS & INDUSTRIAL ELECTRONICS, ISCAIE 2024, 2024, : 462 - 465
  • [2] Data augmentation for aspect-based sentiment analysis
    Guangmin Li
    Hui Wang
    Yi Ding
    Kangan Zhou
    Xiaowei Yan
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 125 - 133
  • [3] Data augmentation for aspect-based sentiment analysis
    Li, Guangmin
    Wang, Hui
    Ding, Yi
    Zhou, Kangan
    Yan, Xiaowei
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2023, 14 (01) : 125 - 133
  • [4] Using Masked Language Modeling to Enhance BERT-Based Aspect-Based Sentiment Analysis for Affective Token Prediction
    Jin, Weiqiang
    Zhao, Biao
    Liu, Chenxing
    Zhang, Heng
    Jiang, Mengying
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PART X, 2023, 14263 : 530 - 542
  • [5] Data Augmentation in a Hybrid Approach for Aspect-Based Sentiment Analysis
    Liesting, Tomas
    Frasincar, Flavius
    Trusca, Maria Mihaela
    36TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2021, 2021, : 828 - 835
  • [6] Adversarial Training for Aspect-Based Sentiment Analysis with BERT
    Karimi, Akbar
    Rossi, Leonardo
    Prati, Andrea
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8797 - 8803
  • [7] A BERT-based Hierarchical Model for Vietnamese Aspect Based Sentiment Analysis
    Oanh Thi Tran
    Viet The Bui
    2020 12TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SYSTEMS ENGINEERING (IEEE KSE 2020), 2020, : 269 - 274
  • [8] Aspect-Based Sentiment Analysis Using Adversarial BERT with Capsule Networks
    Peng Yang
    Penghui Zhang
    Bing Li
    Shunhang Ji
    Meng Yi
    Neural Processing Letters, 2023, 55 : 8041 - 8058
  • [9] Aspect-Based Sentiment Analysis Using Adversarial BERT with Capsule Networks
    Yang, Peng
    Zhang, Penghui
    Li, Bing
    Ji, Shunhang
    Yi, Meng
    NEURAL PROCESSING LETTERS, 2023, 55 (06) : 8041 - 8058
  • [10] Enhancing aspect-based sentiment analysis using data augmentation based on back-translation
    Taheri, Alireza
    Zamanifar, Azadeh
    Farhadi, Amirfarhad
    INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2024, : 491 - 516