Deep Convolutional Computation Model for Feature Learning on Big Data in Internet of Things

被引:158
作者
Li, Peng [1 ,2 ]
Chen, Zhikui [1 ,2 ]
Yang, Laurence Tianruo [3 ]
Zhang, Qingchen [3 ]
Deen, M. Jamal [4 ]
机构
[1] Dalian Univ Technol, Key Lab Ubiquitous Network & Serv Software Liaoni, Dalian 116023, Peoples R China
[2] Dalian Univ Technol, Sch Software Technol, Dalian 116023, Peoples R China
[3] St Francis Xavier Univ, Dept Comp Sci, Antigonish, NS B2G 2W5, Canada
[4] McMaster Univ, Dept Elect & Comp Engn, Hamilton, ON L8S 4L8, Canada
基金
中国国家自然科学基金;
关键词
Big data; convolutional neural network (CNN); deep convolutional computation model (DCCM); high-order backpropagation (HBP) algorithm; Internet of Things (IoT); tensor computation;
D O I
10.1109/TII.2017.2739340
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Currently, a large number of industrial data, usually referred to big data, are collected from Internet of Things (IoT). Big data are typically heterogeneous, i.e., each object in big datasets is multimodal, posing a challenging issue on the convolutional neural network (CNN) that is one of the most representative deep learning models. In this paper, a deep convolutional computation model (DCCM) is proposed to learn hierarchical features of big data by using the tensor representation model to extend the CNN from the vector space to the tensor space. To make full use of the local features and topologies contained in the big data, a tensor convolution operation is defined to prevent over-fitting and improve the training efficiency. Furthermore, a high-order backpropagation algorithm is proposed to train the parameters of the deep convolutional computational model in the high-order space. Finally, experiments on three datasets, i.e., CUAVE, SNAE2, and STL-10 are carried out to verify the performance of the DCCM. Experimental results show that the deep convolutional computation model can give higher classification accuracy than the deep computation model or the multimodal model for big data in IoT.
引用
收藏
页码:790 / 798
页数:9
相关论文
共 25 条
[1]   Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications [J].
Adrian Corneanu, Ciprian ;
Oliu Simon, Marc ;
Cohn, Jeffrey F. ;
Escalera Guerrero, Sergio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (08) :1548-1568
[2]  
[Anonymous], 2012, P INT C NEUR INF PRO
[3]  
[Anonymous], 2016, ACM T INTEL SYST TEC
[4]  
[Anonymous], 2011, P 28 INT C MACH LEAR
[5]  
[Anonymous], 2014, Advances in neural information processing systems
[6]  
[Anonymous], PROC CVPR IEEE
[7]  
[Anonymous], 2015, PROC CVPR IEEE
[8]  
[Anonymous], P INT C LEARN REPR
[9]   Robust Face Recognition via Multimodal Deep Face Representation [J].
Ding, Changxing ;
Tao, Dacheng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (11) :2049-2058
[10]   Approximate event detection over multi-modal sensing data [J].
Gao, Jing ;
Li, Jianzhong ;
Li, Yingshu .
JOURNAL OF COMBINATORIAL OPTIMIZATION, 2016, 32 (04) :1002-1016