Deep-Sentiment: An Effective Deep Sentiment Analysis Using a Decision-Based Recurrent Neural Network (D-RNN)

被引:11
作者
Durga, Putta [1 ]
Godavarthi, Deepthi [1 ]
机构
[1] VIT AP Univ, Sch Comp Sci & Engn, Amaravati 522237, Andhra Pradesh, India
关键词
Sentiment analysis; BERT-large-cased (BLC); stochastic gradient descent (SGD); bag-of-words (BoW); deep sentiment analysis (DSA); CLASSIFICATION; ATTENTION; COVID-19;
D O I
10.1109/ACCESS.2023.3320738
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sentiment analysis is a sub-domain in opinion mining that extracts sentiments from the users' opinions from text messages. Opinions from E-commerce websites, blogs, online social media, etc., and these opinions are in the form of text, suggestions, and comments. This paper describes the new sentiment analysis model to predict sentiments effectively that can be used to improve product quality and sales. The proposed approach is an integrated model combining several techniques, such as the pre-trained model BERT-large-cased (BLC) for training the dataset. BLC model contains 24-layer, 1024-hidden, 16-heads, 340M parameters. Optimization algorithms can fine-tune pre-trained models, such as BERT, for sentiment analysis tasks. Fine-tuning involves training the pre-trained model on a specific sentiment analysis task to improve performance. Stochastic Gradient Descent (SGD) is the optimized algorithm that helps to analyze the sentiments effectively from the given datasets. The next step is the combination of pre-processing techniques such as Tokenization, Stop Word Removal, etc. The next step focused on Bag-of-Words (BoW) and word embedding techniques like Word2Vec used to extract the features from the datasets. The deep sentiment analysis (DSA) based classification is designed to classify the sentiments based on aspect and priority model to achieve better results. The proposed model combines Aspect and Priority-based Sentiment analysis with a Decision-based Recurrent Neural Network (D-RNN). The experiments are conducted using Twitter, Restaurant, and Laptop datasets available publicly on Kaggle-the proposed model's performance is analyzed using a confusion matrix. The proposed approach addresses various challenges in analyzing the sentiment analysis. Python programming language with several libraries such as Keras, Pandas, and others extracts the sentiments from given datasets. The comparison between the existing and proposed models shows the effectiveness of the sentiment outputs.
引用
收藏
页码:108433 / 108447
页数:15
相关论文
共 50 条
  • [1] Ajagbe SA, 2021, INT J ADV COMPUT RES, V11, P51, DOI DOI 10.19101/IJACR.2021.1152001
  • [2] Deep learning techniques for detection and prediction of pandemic diseases: a systematic literature review
    Ajagbe, Sunday Adeola
    Adigun, Matthew O.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (2) : 5893 - 5927
  • [3] Al-Janabi Omar Mustafa, 2022, 2022 International Conference on Data Science and Intelligent Computing (ICDSIC), P14, DOI 10.1109/ICDSIC56987.2022.10076109
  • [4] A survey of Twitter research: Data model, graph structure, sentiment analysis and attacks?
    Antonakaki, Despoina
    Fragopoulou, Paraskevi
    Ioannidis, Sotiris
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 164
  • [5] Aslanian E., 2016, IEEE Transactions on Industrial Informatics, DOI [DOI 10.1109/TII.2016.2631138, 10.1109/TII.2016.2631138]
  • [6] Exploring Diverse Features for Sentiment Quantification Using Machine Learning Algorithms
    Ayyub, Kashif
    Iqbal, Saqib
    Munir, Ehsan Ullah
    Nisar, Muhammad Wasif
    Abbasi, Momna
    [J]. IEEE ACCESS, 2020, 8 : 142819 - 142831
  • [7] Predicting Supervise Machine Learning Performances for Sentiment Analysis Using Contextual-Based Approaches
    Aziz, Azwa Abdul
    Starkey, Andrew
    [J]. IEEE ACCESS, 2020, 8 : 17722 - 17733
  • [8] Deep Learning for AI
    Bengio, Yoshua
    Lecun, Yann
    Hinton, Geoffrey
    [J]. COMMUNICATIONS OF THE ACM, 2021, 64 (07) : 58 - 65
  • [10] Mayfly in Harmony: A New Hybrid Meta-Heuristic Feature Selection Algorithm
    Bhattacharyya, Trinav
    Chatterjee, Bitanu
    Singh, Pawan Kumar
    Yoon, Jin Hee
    Geem, Zong Woo
    Sarkar, Ram
    [J]. IEEE ACCESS, 2020, 8 : 195929 - 195945