RecogNet-LSTM plus CNN: a hybrid network with attention mechanism for aspect categorization and sentiment classification

被引:30
作者
Ramaswamy, Srividhya Lakshmi [1 ]
Chinnappan, Jayakumar [2 ]
机构
[1] Anna Univ, RMK Coll Engn & Technol, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
[2] Anna Univ, Sri Venkateswara Coll Engn, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
关键词
Sentiment analysis; RecogNet; Long short-term memory; Convolutional neural network; Attention mechanism; EXTRACTION;
D O I
10.1007/s10844-021-00692-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sentiment analysis for user reviews has received substantial heed in recent years. There are many deep learning models for natural language processing (NLP) applications. Long-short term memory (LSTM) and Convolutional neural network (CNN) based models efficiently enhance sentiment accuracy. Aspect-level sentiment analysis involves aspect extraction, aspect categorization, and polarity classification. The aspect sentiments in the dataset are classified as positive, negative, and neutral, depending on the polarity score associated with the aspect emotions. Existing neural architectures combining LSTM and CNN employ only the implicit information from the dataset for sentiment classification. Alternatively, this paper highlights the integration of explicit knowledge from the external database (RecogNet) with the implicit information of the LSTM model to improvise the sentiment accuracy. Incorporating sentic and semantic clues from the RecogNet knowledge base to the LSTM increases aspect extraction and categorization efficiency. Furthermore, we implemented CNN with target and position attention mechanisms over the RecogNet-LSTM layer to further enhance the classification accuracy. Finally, the model evaluations are performed using five online datasets related to the restaurants, laptops, and locations. Among LSTM based hybrid models, our RecogNet-LSTM+CNN model with attention mechanism showed superior performance in aspect categorization and opinion classification.
引用
收藏
页码:379 / 404
页数:26
相关论文
共 46 条
  • [21] Ensemble Deep Learning for Aspect-based Sentiment Analysis
    Mohammadi, Azadeh
    Shaverizade, Anis
    [J]. INTERNATIONAL JOURNAL OF NONLINEAR ANALYSIS AND APPLICATIONS, 2021, 12 : 29 - 38
  • [22] Mousa AED, 2017, 15TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (EACL 2017), VOL 1: LONG PAPERS, P1023
  • [23] Pennington Jeffrey, 2014, P 2014 C EMPIRICAL M, P1532, DOI [10.3115/v1/D14-1162, DOI 10.3115/V1/D14-1162]
  • [24] Pontiki M., 2015, P 9 INT WORKSHOP SEM, P486, DOI [10.18653/v1/s15-2082, DOI 10.18653/V1/S15-2082]
  • [25] Pontiki M., 2014, P 8 INT WORKSHOP SEM, P27, DOI DOI 10.3115/V1/S14-2004
  • [26] Pontiki Maria, 2016, PROWORKSHOP SEM EV S, P19, DOI [10.18653/v1/S16-1002, DOI 10.18653/V1/S16-1002]
  • [27] Aspect extraction for opinion mining with a deep convolutional neural network
    Poria, Soujanya
    Cambria, Erik
    Gelbukh, Alexander
    [J]. KNOWLEDGE-BASED SYSTEMS, 2016, 108 : 42 - 49
  • [28] Rajagopal D, 2013, PROCEEDINGS OF THE 22ND INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'13 COMPANION), P565
  • [29] Saeidi M., 2016, P 26 INT C COMP LING, P1546
  • [30] Empirical study of sentiment analysis tools and techniques on societal topics
    Singh, Loitongbam Gyanendro
    Singh, Sanasam Ranbir
    [J]. JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2021, 56 (02) : 379 - 407