Adaptive Convolutional Neural Network and Its Application in Face Recognition

被引:75
作者
Zhang, Yuanyuan [1 ]
Zhao, Dong [2 ]
Sun, Jiande [2 ,3 ]
Zou, Guofeng [4 ]
Li, Wentao [2 ]
机构
[1] Shandong Acad Sci, Informat Res Inst, Jinan 250014, Peoples R China
[2] Shandong Univ, Sch Informat Sci & Engn, Jinan 250100, Peoples R China
[3] Hisense State Key Lab Digital Media Technol, Qingdao 266061, Peoples R China
[4] Shandong Univ Technol, Coll Elect & Elect Engn, Zibo 255049, Peoples R China
关键词
Convolutional neural network; Network construction; Adaptive convolutional neural network; Global expansion; Local expansion; Incremental learning;
D O I
10.1007/s11063-015-9420-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural network (CNN) has more and more applications in image recognition. However, the structure of CNN is often determined after a performance comparison among the CNNs with different structures, which impedes the further development of CNN. In this paper, an adaptive convolutional neural network (ACNN) is proposed, which can determine the structure of CNN without performance comparison. The final structure of ACNN is determined by automatic expansion according to performance requirement. First, the network is initialized by a one-branch structure. The system average error and recognition rate of the training samples are set to control the expansion of the structure of CNN. That is to say, the network is extended by global expansion until the system average error meets the requirement and when the system average error is satisfied, the local network is expanded until the recognition rate meets the requirement. Finally, the structure of CNN is determined automatically. Besides, the incremental learning for new samples can be achieved by adding new branches while keeping the original network unchanged. The experiment results of face recognition on ORL face database show that there is a better tradeoff between the consumption of training time and the recognition rate in ACNN.
引用
收藏
页码:389 / 399
页数:11
相关论文
共 13 条
[1]  
[Anonymous], USING CMU PIE HUMAN
[2]   Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks [J].
Chen, Xueyun ;
Xiang, Shiming ;
Liu, Cheng-Lin ;
Pan, Chun-Hong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2014, 11 (10) :1797-1801
[3]  
Cheung B., 2011, Proceedings of the 2011 Tenth International Conference on Machine Learning and Applications (ICMLA 2011), P293, DOI 10.1109/ICMLA.2011.73
[4]  
Farabet C, 2010, IEEE INT SYMP CIRC S, P257, DOI 10.1109/ISCAS.2010.5537908
[5]  
Garcia C, 2002, INT C PATT RECOG, P44, DOI 10.1109/ICPR.2002.1048232
[6]  
Gu Jia-ling, 2009, Journal of System Simulation, V21, P2441
[7]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[8]   Backpropagation Applied to Handwritten Zip Code Recognition [J].
LeCun, Y. ;
Boser, B. ;
Denker, J. S. ;
Henderson, D. ;
Howard, R. E. ;
Hubbard, W. ;
Jackel, L. D. .
NEURAL COMPUTATION, 1989, 1 (04) :541-551
[9]   Evaluation of convolutional neural networks for visual recognition [J].
Neubauer, C .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (04) :685-696
[10]  
Peemen M, 2013, 2013 IEEE 31ST INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD), P13, DOI 10.1109/ICCD.2013.6657019