Sentiment analysis based on aspect and context fusion using attention encoder with LSTM

被引:0
作者
Soni J. [1 ]
Mathur K. [2 ]
机构
[1] Institute of Engineering and Technology, Devi Ahilya University, Indore
[2] International Institute of Professional Studies, Devi Ahilya University, Indore
关键词
Long short term memory; Natural language processing; Sentiment analysis; Social media;
D O I
10.1007/s41870-022-00966-1
中图分类号
学科分类号
摘要
Sentiment analysis is a type of natural language processing approach that identifies the emotional tone hidden within a body of text by using machine learning techniques. It would be beneficial to consider the aspects and contexts that are hidden behind the text in order to identify the hidden tone. We propose a hybrid model in this research, based on the fusion of Long short term memory (LSTM) and Encoder with attention for sentiment analysis. We’ve taken into account a variety of factors and different contexts and aspects when analyzing a tweet’s word or phrase. Encoder attention mechanism is used to calculate aspect relevance whereas to obtain the related context, we employ Paragraph2vec to facilitate the process of determining contextual meaning. Paragraph2vec and encoder output features were combined and fed into the LSTM for classification. We carried out experiments using the Twitter Sentiment140 dataset. The results of fusion model is being compared with the LSTM, Bi-directional LSTM and Bidirectional Encoder Representations from Transformers (BERT) model and the results of the tests show that our method outperforms the baseline models that are currently available. © 2022, The Author(s), under exclusive licence to Bharati Vidyapeeth's Institute of Computer Applications and Management.
引用
收藏
页码:3611 / 3618
页数:7
相关论文
共 32 条
[1]  
Cambria E., Das D., Bandyopadhyay S., Feraco A., Et al., A Practical Guide to Sentiment Analysis, (2017)
[2]  
Zarate J.M., Santiago S.M., Sentiment analysis through machine learning for the support on decision-making in job interviews, International Conference on Human–Computer Interaction, pp. 202-213, (2019)
[3]  
Xiong S., Wang K., Ji D., Wang B., A short text sentiment-topic model for product reviews, Neurocomputing, 297, pp. 94-102, (2018)
[4]  
Gross-Klussmann A., Konig S., Ebner M., Buzzwords build momentum: global financial twitter sentiment and the aggregate stock market, Expert Syst Appl, 136, pp. 171-186, (2019)
[5]  
Lin C., He Y., Joint sentiment/topic model for sentiment analysis, Proceedings of the 18Th ACM Conference on Information and Knowledge Management, pp. 375-384, (2009)
[6]  
Shoukry A., Rafea A., Sentence-level arabic sentiment analysis, 2012 International Conference on Collaboration Technologies and Systems (CTS). IEEE, pp. 546-550, (2012)
[7]  
Schouten K., Frasincar F., Survey on aspect-level sentiment analysis, IEEE Trans Knowl Data Eng, 28, 3, pp. 813-830, (2015)
[8]  
Zhang L., Wang S., Liu B., Deep learning for sentiment analysis: a survey, Wiley Interdiscip Rev Data Min Knowl Discov, 8, 4, (2018)
[9]  
Tang D., Qin B., Feng X., Liu T., Effective Lstms for Target-Dependent Sentiment Classification. Arxiv Preprint Arxiv, 1512, (2015)
[10]  
Wang Y., Huang M., Zhu X., Zhao L., Attention-based lstm for aspect-level sentiment classification, Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp. 606-615, (2016)