Distilroberta2gnn: a new hybrid deep learning approach for aspect-based sentiment analysis

被引:4
作者
Alhadlaq, Aseel [1 ]
Altheneyan, Alaa [1 ]
机构
[1] King Saud Univ, Coll Appl Studies & Community Serv, Dept Comp Sci & Engn, Riyadh, Saudi Arabia
关键词
Sentiment analysis; Aspect-based sentiment analysis; Graph neural network; BERT; DistilRoBERTa2GNN;
D O I
10.7717/peerj-cs.2267
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the fi eld of natural language processing (NLP), aspect-based sentiment analysis (ABSA) is crucial for extracting insights from complex human sentiments towards specific fi c text aspects. Despite significant fi cant progress, the fi eld still faces challenges such as accurately interpreting subtle language nuances and the scarcity of high-quality, domain-specific fi c annotated datasets. This study introduces the DistilRoBERTa2GNN model, an innovative hybrid approach that combines the DistilRoBERTa pre-trained model's ' s feature extraction capabilities with the dynamic sentiment classification fi cation abilities of graph neural networks (GNN). Our comprehensive, four-phase data preprocessing strategy is designed to enrich model training with domain-specific, fi c, high-quality data. In this study, we analyze four publicly available benchmark datasets: Rest14, Rest15, Rest16-EN, and Rest16-ESP, to rigorously evaluate the effectiveness of our novel DistilRoBERTa2GNN model in ABSA. For the Rest14 dataset, our model achieved an F1 score of 77.98%, precision of 78.12%, and recall of 79.41%. The Rest15 dataset shows that our model achieves an F1 score of 76.86%, precision of 80.70%, and recall of 79.37%. For the Rest16-EN dataset, our model reached an F1 score of 84.96%, precision of 82.77%, and recall of 87.28%. For Rest16-ESP (Spanish dataset), our model achieved an F1 score of 74.87%, with a precision of 73.11% and a recall of 76.80%. These metrics highlight our model's ' s competitive edge over different baseline models used in ABSA studies. This study addresses critical ABSA challenges and sets a new benchmark for sentiment analysis research, guiding future efforts toward enhancing model adaptability and performance across diverse datasets.
引用
收藏
页数:31
相关论文
共 61 条
[31]  
Zhang M, 2020, PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), P3540
[32]   Aspect-based Sentiment Analysis to Review Products Using Naive Bayes [J].
Mubarok, Mohamad Syahrul ;
Adiwijaya ;
Aldhi, Muhammad Dwi .
INTERNATIONAL CONFERENCE ON MATHEMATICS: PURE, APPLIED AND COMPUTATION: EMPOWERING ENGINEERING USING MATHEMATICS, 2017, 1867
[33]   Bidirectional convolutional recurrent neural network architecture with group-wise enhancement mechanism for text sentiment classification [J].
Onan, Aytug .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (05) :2098-2117
[34]   Supervised Learning Based Approach to Aspect Based Sentiment Analysis [J].
Pannala, Nipuna Upeka ;
Nawarathna, Chamira Priyamanthi ;
Jayakody, J. T. K. ;
Rupasinghe, Lakmal ;
Krishnadeva, Kesavan .
2016 IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (CIT), 2016, :662-666
[35]  
Pontiki M, 2015, P 9 INT WORKSH SEM E, P486, DOI DOI 10.18653/V1
[36]  
Pontiki M., 2016, P 10 INT WORKSH SEM, P19, DOI DOI 10.18653/V1/S16-1002
[37]  
Pramanik Vishal, 2022, 2022 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS), P811, DOI 10.1109/ICCCIS56430.2022.10037634
[38]  
Sanh V, 2020, Arxiv, DOI [arXiv:1910.01108, DOI 10.48550/ARXIV.1910.01108]
[39]  
Sankar H, 2017, PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON INTELLIGENT SUSTAINABLE SYSTEMS (ICISS 2017), P87, DOI 10.1109/ISS1.2017.8389293
[40]   The Graph Neural Network Model [J].
Scarselli, Franco ;
Gori, Marco ;
Tsoi, Ah Chung ;
Hagenbuchner, Markus ;
Monfardini, Gabriele .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (01) :61-80