Text Sentiment Analysis Based on Multi-Layer Bi-Directional LSTM with a Trapezoidal Structure

被引:5
|
作者
He, Zhengfang [1 ,2 ]
Dumdumaya, Cristina E. [2 ]
Machica, Ivy Kim D. [2 ]
机构
[1] Yunnan Technol & Business Univ, Sch Intelligent Sci & Engn, Kunming 650000, Peoples R China
[2] Univ Southeastern Philippines, Coll Informat & Comp, Davao, Davao Del Sur, Philippines
关键词
Text sentiment; Bi-directional LSTM; Trapezoidal structure;
D O I
10.32604/iasc.2023.035352
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sentiment analysis, commonly called opinion mining or emotion artificial intelligence (AI), employs biometrics, computational linguistics, nat-ural language processing, and text analysis to systematically identify, extract, measure, and investigate affective states and subjective data. Sentiment analy-sis algorithms include emotion lexicon, traditional machine learning, and deep learning. In the text sentiment analysis algorithm based on a neural network, multi-layer Bi-directional long short-term memory (LSTM) is widely used, but the parameter amount of this model is too huge. Hence, this paper proposes a Bi-directional LSTM with a trapezoidal structure model. The design of the trapezoidal structure is derived from classic neural networks, such as LeNet-5 and AlexNet. These classic models have trapezoidal-like structures, and these structures have achieved success in the field of deep learning. There are two benefits to using the Bi-directional LSTM with a trapezoidal structure. One is that compared with the single-layer configuration, using the of the multi-layer structure can better extract the high-dimensional features of the text. Another is that using the trapezoidal structure can reduce the model's parameters. This paper introduces the Bi-directional LSTM with a trapezoidal structure model in detail and uses Stanford sentiment treebank 2 (STS-2) for experiments. It can be seen from the experimental results that the trapezoidal structure model and the normal structure model have similar performances. However, the trapezoidal structure model parameters are 35.75% less than the normal structure model.
引用
收藏
页码:639 / 654
页数:16
相关论文
共 18 条
  • [1] Short-Term Prediction of Residential Power Energy Consumption via CNN and Multi-Layer Bi-Directional LSTM Networks
    Ullah, Fath U. Min
    Ullah, Amin
    Ul Haq, Ijaz
    Rho, Seungmin
    Baik, Sung Wook
    IEEE ACCESS, 2020, 8 : 123369 - 123380
  • [2] Prognostics Analysis of Rolling Bearing Based on Bi-Directional LSTM and Attention Mechanism
    Rathore, Maan Singh
    Harsha, S. P.
    JOURNAL OF FAILURE ANALYSIS AND PREVENTION, 2022, 22 (02) : 704 - 723
  • [3] Prognostics Analysis of Rolling Bearing Based on Bi-Directional LSTM and Attention Mechanism
    Maan Singh Rathore
    S. P. Harsha
    Journal of Failure Analysis and Prevention, 2022, 22 : 704 - 723
  • [4] Sentiment Analysis of Text Based on Bidirectional LSTM With Multi-Head Attention
    Long, Fei
    Zhou, Kai
    Ou, Weihua
    IEEE ACCESS, 2019, 7 : 141960 - 141969
  • [5] Improving pix2code based Bi-directional LSTM
    Liu, Yanbin
    Hu, Qidi
    Shu, Kunxian
    PROCEEDINGS OF 2018 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION, ELECTRONICS AND ELECTRICAL ENGINEERING (AUTEEE), 2018, : 220 - 223
  • [6] Code Defect Detection Model with Multi-layer Bi-directional Long Short Term Memory based on Self-Attention Mechanism
    Hou, Cong
    Sun, Yue
    Li, Lin
    Chen, Wei
    Xu, Xiaotian
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 1656 - 1660
  • [7] Exploiting bi-directional deep neural networks for multi-domain sentiment analysis using capsule network
    Alireza Ghorbanali
    Mohammad Karim Sohrabi
    Multimedia Tools and Applications, 2023, 82 : 22943 - 22960
  • [8] Exploiting bi-directional deep neural networks for multi-domain sentiment analysis using capsule network
    Ghorbanali, Alireza
    Sohrabi, Mohammad Karim
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (15) : 22943 - 22960
  • [9] Stock Price Prediction using Bi-Directional LSTM based Sequence to Sequence Modeling and Multitask Learning
    Mootha, Siddartha
    Sridhar, Sashank
    Seetharaman, Rahul
    Chitrakala, S.
    2020 11TH IEEE ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2020, : 78 - 86
  • [10] A cloud-based Bi-directional LSTM approach to grid-connected solar PV energy forecasting for multi-energy systems
    Liu, Qi
    Darteh, Oscar Famous
    Bilal, Muhammad
    Huang, Xianming
    Attique, Muhammad
    Liu, Xiaodong
    Acakpovi, Amevi
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2023, 40