RecogNet-LSTM plus CNN: a hybrid network with attention mechanism for aspect categorization and sentiment classification

被引:30
作者
Ramaswamy, Srividhya Lakshmi [1 ]
Chinnappan, Jayakumar [2 ]
机构
[1] Anna Univ, RMK Coll Engn & Technol, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
[2] Anna Univ, Sri Venkateswara Coll Engn, Dept Comp Sci & Engn, Chennai, Tamil Nadu, India
关键词
Sentiment analysis; RecogNet; Long short-term memory; Convolutional neural network; Attention mechanism; EXTRACTION;
D O I
10.1007/s10844-021-00692-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sentiment analysis for user reviews has received substantial heed in recent years. There are many deep learning models for natural language processing (NLP) applications. Long-short term memory (LSTM) and Convolutional neural network (CNN) based models efficiently enhance sentiment accuracy. Aspect-level sentiment analysis involves aspect extraction, aspect categorization, and polarity classification. The aspect sentiments in the dataset are classified as positive, negative, and neutral, depending on the polarity score associated with the aspect emotions. Existing neural architectures combining LSTM and CNN employ only the implicit information from the dataset for sentiment classification. Alternatively, this paper highlights the integration of explicit knowledge from the external database (RecogNet) with the implicit information of the LSTM model to improvise the sentiment accuracy. Incorporating sentic and semantic clues from the RecogNet knowledge base to the LSTM increases aspect extraction and categorization efficiency. Furthermore, we implemented CNN with target and position attention mechanisms over the RecogNet-LSTM layer to further enhance the classification accuracy. Finally, the model evaluations are performed using five online datasets related to the restaurants, laptops, and locations. Among LSTM based hybrid models, our RecogNet-LSTM+CNN model with attention mechanism showed superior performance in aspect categorization and opinion classification.
引用
收藏
页码:379 / 404
页数:26
相关论文
共 46 条
  • [1] [Anonymous], 2016, P 10 INT WORKSHOP SE
  • [2] ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis
    Basiri, Mohammad Ehsan
    Nemati, Shahla
    Abdar, Moloud
    Cambria, Erik
    Acharya, U. Rajendra
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 115 : 279 - 294
  • [3] SenticNet 6: Ensemble Application of Symbolic and Subsymbolic AI for Sentiment Analysis
    Cambria, Erik
    Li, Yang
    Xing, Frank Z.
    Poria, Soujanya
    Kwok, Kenneth
    [J]. CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 105 - 114
  • [4] Affective Computing and Sentiment Analysis
    Cambria, Erik
    [J]. IEEE INTELLIGENT SYSTEMS, 2016, 31 (02) : 102 - 107
  • [5] Cambria E, 2015, AAAI CONF ARTIF INTE, P508
  • [6] Cambria E, 2009, LECT NOTES COMPUT SC, V5707, P252, DOI 10.1007/978-3-642-04391-8_33
  • [7] Enhancing Recurrent Neural Networks with Positional Attention for Question Answering
    Chen, Qin
    Hu, Qinmin
    Huang, Jimmy Xiangji
    He, Liang
    An, Weijie
    [J]. SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, : 993 - 996
  • [8] Yahoo! for Amazon: Sentiment extraction from small talk on the web
    Das, Sanjiv R.
    Chen, Mike Y.
    [J]. MANAGEMENT SCIENCE, 2007, 53 (09) : 1375 - 1388
  • [9] Dong L, 2014, PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 2, P49
  • [10] Gehring J, 2017, PR MACH LEARN RES, V70