Sentiment Analysis Using Residual Learning with Simplified CNN Extractor

被引:9
作者
Nguyen KhaiThinh [1 ]
Cao Hong Nga [1 ]
Lee, Yuan-Shan [3 ]
Wu, Meng-Lun [3 ]
Chang, Pao-Chi [2 ]
Wang, Jia-Ching [1 ]
机构
[1] Natl Cent Univ, Dept Comp Sci & Informat Engn, Taoyuan, Taiwan
[2] Natl Cent Univ, Dept Commun Engn, Taoyuan, Taiwan
[3] Taboola Inc, New York, NY USA
来源
2019 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2019) | 2019年
关键词
sentiment analysis; neural network; convolutional neural network; recurrent neural network;
D O I
10.1109/ISM46123.2019.00075
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sentiment analysis has an important role in social media monitoring as it extracts public opinions, emotions, and feelings about certain products or services. There are several publications in building a system to identify opinions from text using rule-based approach, lexicon-based approach, or machine learning. In this paper, we propose and compare several deep learning models to solve sentiment analysis problem of the Internet Movie Database (IMDb) review sentiment dataset. The feature extractor consists of a convolutional layer, followed by a max pooling layer and a batch normalization layer. To solve the vanishing gradient problem, we use a residual connection to concatenate the input values with the extracted features before feeding the output into a recurrent layer. Our best model has an accuracy of 90.02%.
引用
收藏
页码:335 / 338
页数:4
相关论文
共 12 条
[1]  
[Anonymous], 2014, C EMP METH NAT LANG
[2]  
Graves A, 2012, STUD COMPUT INTELL, V385, P1, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[3]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[4]  
Kim Y, 2014, IEEE ASME INT C ADV, P1747, DOI 10.1109/AIM.2014.6878336
[5]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324
[6]   Recursive Deep Learning for Sentiment Analysis over Social Data [J].
Li, Changliang ;
Xu, Bo ;
Wu, Gaowei ;
He, Saike ;
Tian, Guanhua ;
Hao, Hongwei .
2014 IEEE/WIC/ACM INTERNATIONAL JOINT CONFERENCES ON WEB INTELLIGENCE (WI) AND INTELLIGENT AGENT TECHNOLOGIES (IAT), VOL 2, 2014, :180-185
[7]  
Mccallum Andrew., 2001, Work Learn Text Categ, P752, DOI DOI 10.3115/1067807.1067848
[8]  
Pouransari Hadi., 2015, Deep learning for sentiment analysis of movie reviews
[9]  
Troussas C, 2013, 2013 INTERNATIONAL CONFERENCE ON COMPUTER, INFORMATION AND TELECOMMUNICATION SYSTEMS (CITS)
[10]  
Yenter A, 2017, 2017 IEEE 8TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS AND MOBILE COMMUNICATION CONFERENCE (UEMCON), P540, DOI 10.1109/UEMCON.2017.8249013