RegGRU-Opt: A Robust GRU-Based RNN Model for High-Performance Sentiment Analysis and Binary Classification

被引:0
作者
Chhabra, Aashita [1 ]
Alam, Mansaf [1 ]
机构
[1] Jamia Millia Islamia, Dept Comp Sci, New Delhi, India
关键词
Semantic analysis; Machine learning; Deep learning; Neural network models; CNN;
D O I
10.1007/s13369-024-09943-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This study presents an optimized recurrent neural network architecture, termed "RegGRU-Opt", designed for binary classification tasks such as sentiment analysis on Amazon reviews. By integrating gated recurrent units (GRUs), strategic dropout layers, L2 regularization in dense layers, and advanced optimization techniques (e.g., early stopping and learning rate scheduling), the proposed model achieves robust generalization and outperforms baseline models like CNN, RNN, and SeqClassRNN. Experimental results show high accuracy (approximate to 98%), F1-Score (approximate to 97%), and ROC AUC (approximate to 99%), underscoring the model's capacity to capture nuanced textual patterns. Data balancing methods, including SMOTE and SMOTE + Tomek Links, ensure fair representation of both classes, while feature importance analyses (Chi-squared and SHAP) enhance model interpretability. Despite improved performance, challenges remain in terms of domain adaptation, computational resources, and handling imbalanced data. Future work will focus on exploring hybrid models, advanced regularization methods, broader datasets, and improved efficiency, ultimately expanding the applicability of RegGRU-Opt across diverse real-world text classification scenarios.
引用
收藏
页数:40
相关论文
共 38 条
  • [21] Khan A, 2016, Arxiv, DOI arXiv:1607.02355
  • [22] Machine-learning-based deep semantic analysis approach for forecasting new technology convergence
    Kim, Tae San
    Sohn, So Young
    [J]. TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2020, 157
  • [23] Kumar S., 2024, Artif. Intell. Blockchain, V1, P322
  • [24] Machine learning and semantic analysis of in-game chat for cyberbullying
    Murnion, Shane
    Buchanan, William J.
    Smales, Adrian
    Russell, Gordon
    [J]. COMPUTERS & SECURITY, 2018, 76 : 197 - 213
  • [25] Pereira JFF, 2017, Arxiv, DOI arXiv:1709.03406
  • [26] Application of Semantic Analysis and LSTM-GRU in Developing a Personalized Course Recommendation System
    Premalatha, Mariappan
    Viswanathan, Vadivel
    Cepova, Lenka
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (21):
  • [27] Priyantina R A., 2019, Int. J. Intell. Eng. Syst, V12, P142, DOI DOI 10.22266/IJIES2019.0831.14
  • [28] Semantic Features for Optimizing Supervised Approach of Sentiment Analysis on Product Reviews
    Rintyarna, Bagus Setya
    Sarno, Riyanarto
    Fatichah, Chastine
    [J]. COMPUTERS, 2019, 8 (03)
  • [29] RoBERTa-GRU: A Hybrid Deep Learning Model for Enhanced Sentiment Analysis
    Tan, Kian Long
    Lee, Chin Poo
    Lim, Kian Ming
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [30] Toti D., 2021, ADV P2P PARALLEL GRI, V15, P211