Combination of GRU and CNN Deep Learning Models for Sentiment Analysis on French Customer Reviews Using XLNet Model

被引:7
|
作者
Habbat N. [1 ]
Anoun H. [1 ]
Hassouni L. [2 ]
机构
[1] Université Hassan Ii de Casablanca, Casablanca
[2] Ritm Laboratory, Ced Ensem Higher School of Technology Hassan Ii University, Casablanca
来源
IEEE Engineering Management Review | 2023年 / 51卷 / 01期
关键词
CamemBERT; convolutional neural networks (CNN); deep learning; French reviews; MultiFiT; recurrent neural networks (RNNs); XLNet;
D O I
10.1109/EMR.2022.3208818
中图分类号
学科分类号
摘要
Sentiment analysis is the task of detecting opinions of people from text using techniques of natural language processing. It is critical in assisting businesses in actively improving their company strategy and better understanding client feedback on their products. Recently, the researchers have shown that deep learning models, namely convolutional neural network (CNN), recurrent neural networks (RNNs), and contextualized transformer-based word embeddings, give hopeful results for extracting sentiment from text. Withal, bidirectional RNN utilizes two directions of RNN to better extract long-term dependences, CNN has the benefit of high-level features extracting, and it may not examine a sequence of correlations efficiently. In addition, the transformer-based word embeddings are the computational resources needed to fine-tune to solve the problem of overfitting on small datasets. For that, we propose in this work a combination of different RNNs models [e.g., long short-term memory (LSTM), bidirectional LSTM, and gated recurrent unit (GRU)] and CNN, using different word embeddings (MultiFiT, XLNet, and CamemBERT). The experimental results show that the combination of GRU and CNN with XLNet has an apparent improvement upon the state of the art on three French datasets: 1) French Amazon Customer Reviews, 2) AlloCiné Dataset, and 3) French Twitter Sentiment Analysis, with 96.5%, 90.1%, and 89.6% accuracies in decreasing order, respectively. © 1973-2011 IEEE.
引用
收藏
页码:41 / 51
页数:10
相关论文
共 50 条
  • [41] A COMPARATIVE STUDY OF MACHINE LEARNING MODELS FOR SENTIMENT ANALYSIS: CUSTOMER REVIEWS OF E-COMMERCE PLATFORMS
    Davoodi, Laleh
    Mezei, Jozsef
    35TH BLED ECONFERENCE DIGITAL RESTRUCTURING AND HUMAN (RE)ACTION, BLED ECONFERENCE 2022, 2022, : 217 - 231
  • [42] Transformer based Contextual Model for Sentiment Analysis of Customer Reviews: A Fine-tuned BERT A Sequence Learning BERT Model for Sentiment Analysis
    Durairaj, Ashok Kumar
    Chinnalagu, Anandan
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (11) : 474 - 480
  • [43] Sentiment Analysis in Customer Reviews for Product Recommendation in E-commerce Using Machine Learning
    Panduro-Ramirez, Jeidy
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [44] Predict customer churn using combination deep learning networks model
    Van-Hieu Vu
    Neural Computing and Applications, 2024, 36 : 4867 - 4883
  • [45] Predict customer churn using combination deep learning networks model
    Vu, Van-Hieu
    NEURAL COMPUTING & APPLICATIONS, 2023, 36 (09): : 4867 - 4883
  • [46] GloVe-CNN-BiLSTM Model for Sentiment Analysis on Text Reviews
    Li, Xiaoyan
    Raga, Rodolfo C.
    Shi, Xuemei
    JOURNAL OF SENSORS, 2022, 2022
  • [47] MBi-GRUMCONV: A novel Multi Bi-GRU and Multi CNN-Based deep learning model for social media sentiment analysis
    Muhammet Sinan Başarslan
    Fatih Kayaalp
    Journal of Cloud Computing, 12
  • [48] MBi-GRUMCONV: A novel Multi Bi-GRU and Multi CNN-Based deep learning model for social media sentiment analysis
    Basarslan, Muhammet Sinan
    Kayaalp, Fatih
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2023, 12 (01):
  • [49] A HYBRID DEEP LEARNING APPROACH FOR SENTIMENT ANALYSIS IN PRODUCT REVIEWS
    Kuang, Minghui
    Safa, Ramin
    Edalatpanah, Seyyed Ahmad
    Keyser, Robert S.
    FACTA UNIVERSITATIS-SERIES MECHANICAL ENGINEERING, 2023, 21 (03) : 479 - 500
  • [50] Comparing deep learning architectures for sentiment analysis on drug reviews
    Colon-Ruiz, Cristobal
    Segura-Bedmar, Isabel
    JOURNAL OF BIOMEDICAL INFORMATICS, 2020, 110