A-optimal convolutional neural network

被引:6
作者
Yin, Zihong [1 ]
Kong, Dehui [1 ]
Shao, Guoxia [1 ]
Ning, Xinran [2 ]
Jin, Warren [3 ]
Wang, Jing-Yan [4 ]
机构
[1] Southwest Jiao Tong Univ, Sch Civil Engn, Chengdu 610031, Sichuan, Peoples R China
[2] Southwest Jiao Tong Univ, Sch Informat Sci & Technol, Chengdu 610031, Sichuan, Peoples R China
[3] Commonwealth Sci & Ind Res Org, GPO Box 664, Canberra, ACT 2601, Australia
[4] New York Univ Abu Dhabi, Abu Dhabi, U Arab Emirates
关键词
A-optimality; Convolutional neural network; Alternate optimization; Gradient descent; Seismic waveform; REPRESENTATION;
D O I
10.1007/s00521-016-2783-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel data representation-classification model learning algorithm. The model is a convolutional neural network (CNN), and we learn its parameters to achieve A-optimality. The input multi-instance data are represented by a CNN model, and then classified by a linear classification model. The A-optimality of a classification model is measured by the trace of the covariance matrix of the model parameter vector. To achieve the A-optimality of the CNN model, we minimize the classification errors and a regularization term to present the classification model parameter as a function of the CNN filter parameters, and minimize its trace of the covariance matrix. We show that the minimization problem can be solved easily by transferring it to another coupled minimization problem. In the experiments over benchmark data sets of molecular, image, and seismic waveform, we show the advantages of the proposed A-optimal CNN model.
引用
收藏
页码:2295 / 2304
页数:10
相关论文
共 43 条
[1]  
Andrews Stuart, 2002, Proceedings of the 15th International Conference on Neural Information Processing Systems. NIPS'02, P561
[2]  
[Anonymous], NEURAL COMPUT APPL
[3]  
[Anonymous], 2014, 52 ANN M ASS COMP LI
[4]  
[Anonymous], 2016 IEEE 28 INT C T
[5]  
[Anonymous], SPIE DEFENSE SECURIT
[6]  
[Anonymous], ARXIV160908417
[7]  
[Anonymous], NEURAL COMPUT APPL
[8]   Combining inconsistent textures using convolutional neural networks [J].
Cai, Xiuxia ;
Song, Bin .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 40 :366-375
[9]   MILES: Multiple-Instance Learning via Embedded instance Selection [J].
Chen, Yixin ;
Bi, Jinbo ;
Wang, James Z. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :1931-1947
[10]   Convolutional Neural Network Committees For Handwritten Character Classification [J].
Ciresan, Dan Claudiu ;
Meier, Ueli ;
Gambardella, Luca Maria ;
Schmidhuber, Juergen .
11TH INTERNATIONAL CONFERENCE ON DOCUMENT ANALYSIS AND RECOGNITION (ICDAR 2011), 2011, :1135-1139