Combination of GRU and CNN Deep Learning Models for Sentiment Analysis on French Customer Reviews Using XLNet Model

被引:7
|
作者
Habbat N. [1 ]
Anoun H. [1 ]
Hassouni L. [2 ]
机构
[1] Université Hassan Ii de Casablanca, Casablanca
[2] Ritm Laboratory, Ced Ensem Higher School of Technology Hassan Ii University, Casablanca
来源
IEEE Engineering Management Review | 2023年 / 51卷 / 01期
关键词
CamemBERT; convolutional neural networks (CNN); deep learning; French reviews; MultiFiT; recurrent neural networks (RNNs); XLNet;
D O I
10.1109/EMR.2022.3208818
中图分类号
学科分类号
摘要
Sentiment analysis is the task of detecting opinions of people from text using techniques of natural language processing. It is critical in assisting businesses in actively improving their company strategy and better understanding client feedback on their products. Recently, the researchers have shown that deep learning models, namely convolutional neural network (CNN), recurrent neural networks (RNNs), and contextualized transformer-based word embeddings, give hopeful results for extracting sentiment from text. Withal, bidirectional RNN utilizes two directions of RNN to better extract long-term dependences, CNN has the benefit of high-level features extracting, and it may not examine a sequence of correlations efficiently. In addition, the transformer-based word embeddings are the computational resources needed to fine-tune to solve the problem of overfitting on small datasets. For that, we propose in this work a combination of different RNNs models [e.g., long short-term memory (LSTM), bidirectional LSTM, and gated recurrent unit (GRU)] and CNN, using different word embeddings (MultiFiT, XLNet, and CamemBERT). The experimental results show that the combination of GRU and CNN with XLNet has an apparent improvement upon the state of the art on three French datasets: 1) French Amazon Customer Reviews, 2) AlloCiné Dataset, and 3) French Twitter Sentiment Analysis, with 96.5%, 90.1%, and 89.6% accuracies in decreasing order, respectively. © 1973-2011 IEEE.
引用
收藏
页码:41 / 51
页数:10
相关论文
共 50 条
  • [21] RoBERTa-GRU: A Hybrid Deep Learning Model for Enhanced Sentiment Analysis
    Tan, Kian Long
    Lee, Chin Poo
    Lim, Kian Ming
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [22] Auto analysis of customer feedback using CNN and GRU network
    Gupta, Deepak
    Lenka, Pabitra
    Bedi, Harsimran
    Ekbal, Asif
    Bhattacharyya, Pushpak
    arXiv, 2017,
  • [23] Sentiment Analysis of Customer Reviews Using Ensemble Method
    Alrehili, Ahlam
    Albalawi, Kholood
    2019 INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION SCIENCES (ICCIS), 2019, : 93 - 98
  • [24] Are customer reviews just reviews? Hotel forecasting using sentiment analysis
    Wu, Doris Chenguang
    Zhong, Shiteng
    Qiu, Richard T. R.
    Wu, Ji
    TOURISM ECONOMICS, 2022, 28 (03) : 795 - 816
  • [25] Regular paper Comparative Analysis of Deep Learning Models for Sentiment Analysis on IMDB Reviews
    Pandit, Kanak
    Patil, Harshali
    Shrimal, Drashti
    Suganya, Lydia
    Deshmukh, Pratiksha
    JOURNAL OF ELECTRICAL SYSTEMS, 2024, 20 (02) : 424 - 433
  • [26] An optimised deep learning model with an Atrous convolutional-based inception system for the sentiment analysis of customer online reviews
    Vaissnave, V.
    Birunda, S. Selva
    Dharani, V.
    Lalitha, R.
    Sudar, K. Muthamil
    JOURNAL OF ENGINEERING DESIGN, 2025,
  • [27] Leveraging Sentiment Analysis to Detect Fake Reviews Using Deep Learning
    Mohit Kumar
    Adarsh Rana
    Arun Kumar Yadav
    Divakar Yadav
    SN Computer Science, 6 (3)
  • [28] LSTM-CNN Deep Learning Model for French Online Product Reviews Classification
    Habbat, Nassera
    Anoun, Houda
    Hassouni, Larbi
    ADVANCED TECHNOLOGIES FOR HUMANITY, 2022, 110 : 228 - 240
  • [29] Sentiment Analysis of Customer Reviews of Food Delivery Services Using Deep Learning and Explainable Artificial Intelligence: Systematic Review
    Adak, Anirban
    Pradhan, Biswajeet
    Shukla, Nagesh
    FOODS, 2022, 11 (10)
  • [30] Customer Sentiment Analysis and Prediction of Insurance Products' Reviews Using Machine Learning Approaches
    Hossain, Md Shamim
    Rahman, Mst Farjana
    FIIB BUSINESS REVIEW, 2023, 12 (04) : 386 - 402