A Multi-Layer Dual Attention Deep Learning Model With Refined Word Embeddings for Aspect-Based Sentiment Analysis

被引:21
作者
Rida-E-Fatima, Syeda [1 ]
Javed, Ali [1 ,2 ]
Banjar, Ameen [3 ]
Irtaza, Aun [4 ]
Dawood, Hassan [1 ]
Dawood, Hussain [5 ]
Alamri, Abdullah [3 ]
机构
[1] Univ Engn & Technol, Dept Software Engn, Taxila 47050, Punjab, Pakistan
[2] Oakland Univ, Dept Comp Sci & Engn, Rochester, MI 48309 USA
[3] Univ Jeddah, Dept Informat Syst & Technol, Coll Comp Sci & Engn, Jeddah 23890, Saudi Arabia
[4] Univ Engn & Technol, Dept Comp Sci, Taxila 47050, Punjab, Pakistan
[5] Univ Jeddah, Dept Comp & Network Engn, Coll Comp Sci & Engn, Jeddah 23890, Saudi Arabia
关键词
Aspect based sentiment analysis; deep learning; natural language processing; opinion mining and word embeddings;
D O I
10.1109/ACCESS.2019.2927281
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Although the sentiment analysis domain has been deeply studied in the last few years, the analysis of social media content is still a challenging task due to the exponential growth of multimedia content. Natural language ambiguities and indirect sentiments within the social media text have made it hard to classify. Aspect-based sentiment analysis creates a need to develop explicit extraction techniques using syntactic parsers to exploit the relationship between the aspect and sentiment terms. Along with the extraction approaches, word embeddings are generated through Word2Vec models for the continuous low-dimensional vector representation of text that fails to capture the significant sentiment information. This paper presents a co-extraction model with refined word embeddings to exploit the dependency structures without using syntactic parsers. For this purpose, a deep learning-based multilayer dual-attention model is proposed to exploit the indirect relation between the aspect and opinion terms. In addition, word embeddings are refined by providing distinct vector representations to dissimilar sentiments, unlike the Word2Vec model. For this, we have employed a sentiment refinement technique for pre-trained word embedding model to overcome the problem of similar vector representations of opposite sentiments. Performance of the proposed model is evaluated on three benchmark datasets of SemEval Challenge 2014 and 2015. The experimental results indicate the effectiveness of our model compared to the existing state-of-the-art models for the aspect-based sentiment analysis.
引用
收藏
页码:114795 / 114807
页数:13
相关论文
共 47 条
[1]  
[Anonymous], 2014, P C EMPR METH NAT
[2]  
[Anonymous], 2009, P 2009 C EMPIRICAL M, DOI 10.3115/1699648.1699700
[3]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[4]   Sentence Compression for Aspect-Based Sentiment Analysis [J].
Che, Wanxiang ;
Zhao, Yanyan ;
Guo, Honglei ;
Su, Zhong ;
Liu, Ting .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2015, 23 (12) :2111-2124
[5]  
Cho K, 2014, ARXIV14061078
[6]  
Dudani S. A., 1976, IEEE Transactions on Systems, Man and Cybernetics, VSMC-6, P325, DOI 10.1109/TSMC.1976.5408784
[7]  
Gregor K, 2015, PR MACH LEARN RES, V37, P1462
[8]  
Hazarika D., 2018, P 2018 C N AM CHAPT, P266
[9]  
Hu MQ, 2004, PROCEEDING OF THE NINETEENTH NATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND THE SIXTEENTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE, P755
[10]  
Irsoy O., 2014, EMNLP, P720, DOI 10.3115/v1/D14-1080