Distilroberta2gnn: a new hybrid deep learning approach for aspect-based sentiment analysis

被引:4
作者
Alhadlaq, Aseel [1 ]
Altheneyan, Alaa [1 ]
机构
[1] King Saud Univ, Coll Appl Studies & Community Serv, Dept Comp Sci & Engn, Riyadh, Saudi Arabia
关键词
Sentiment analysis; Aspect-based sentiment analysis; Graph neural network; BERT; DistilRoBERTa2GNN;
D O I
10.7717/peerj-cs.2267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the fi eld of natural language processing (NLP), aspect-based sentiment analysis (ABSA) is crucial for extracting insights from complex human sentiments towards specific fi c text aspects. Despite significant fi cant progress, the fi eld still faces challenges such as accurately interpreting subtle language nuances and the scarcity of high-quality, domain-specific fi c annotated datasets. This study introduces the DistilRoBERTa2GNN model, an innovative hybrid approach that combines the DistilRoBERTa pre-trained model's ' s feature extraction capabilities with the dynamic sentiment classification fi cation abilities of graph neural networks (GNN). Our comprehensive, four-phase data preprocessing strategy is designed to enrich model training with domain-specific, fi c, high-quality data. In this study, we analyze four publicly available benchmark datasets: Rest14, Rest15, Rest16-EN, and Rest16-ESP, to rigorously evaluate the effectiveness of our novel DistilRoBERTa2GNN model in ABSA. For the Rest14 dataset, our model achieved an F1 score of 77.98%, precision of 78.12%, and recall of 79.41%. The Rest15 dataset shows that our model achieves an F1 score of 76.86%, precision of 80.70%, and recall of 79.37%. For the Rest16-EN dataset, our model reached an F1 score of 84.96%, precision of 82.77%, and recall of 87.28%. For Rest16-ESP (Spanish dataset), our model achieved an F1 score of 74.87%, with a precision of 73.11% and a recall of 76.80%. These metrics highlight our model's ' s competitive edge over different baseline models used in ABSA studies. This study addresses critical ABSA challenges and sets a new benchmark for sentiment analysis research, guiding future efforts toward enhancing model adaptability and performance across diverse datasets.
引用
收藏
页数:31
相关论文
共 61 条
[1]   Gated recurrent unit with multilingual universal sentence encoder for Arabic aspect-based sentiment analysis [J].
AL-Smadi, Mohammad ;
Hammad, Mahmoud M. ;
Al-Zboon, Sa'ad A. ;
AL-Tawalbeh, Saja ;
Cambria, Erik .
KNOWLEDGE-BASED SYSTEMS, 2023, 261
[2]   Semi-supervised Aspect Based Sentiment Analysis for Movies using Review Filtering [J].
Anand, Deepa ;
Naorem, Deepan .
PROCEEDING OF THE SEVENTH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN COMPUTER INTERACTION (IHCI 2015), 2016, 84 :86-93
[3]   Sentiment analysis of extremism in social media from textual information [J].
Asif, Muhammad ;
Ishtiaq, Atiab ;
Ahmad, Haseeb ;
Aljuaid, Hanan ;
Shah, Jalal .
TELEMATICS AND INFORMATICS, 2020, 48
[4]   Attention-based aspect sentiment classification using enhanced learning through CNN-BiLSTM networks [J].
Ayetiran, Eniafe Festus .
KNOWLEDGE-BASED SYSTEMS, 2022, 252
[5]   Survey on Ontology-Based Sentiment Analysis of Customer Reviews for Products and Services [J].
Bandari, Sumalatha ;
Bulusu, Vishnu Vardhan .
DATA ENGINEERING AND COMMUNICATION TECHNOLOGY, ICDECT-2K19, 2020, 1079 :91-101
[6]   Syntactic and Semantic Aware Graph Convolutional Network for Aspect-Based Sentiment Analysis [J].
Chen, Junjie ;
Fan, Hao ;
Wang, Wencong .
IEEE ACCESS, 2024, 12 :22500-22509
[7]  
Chen P., 2017, P 2017 C EMP METH NA, P452, DOI [10.18653/v1/D17-1047, DOI 10.18653/V1/D17-1047]
[8]  
Chen SW, 2021, AAAI CONF ARTIF INTE, V35, P12666
[9]  
Chen Y., 2015, Ph.D. dissertation
[10]  
Devlin J, 2019, Arxiv, DOI [arXiv:1810.04805, DOI 10.48550/ARXIV.1810.04805]