Sensitive deep convolutional neural network for face recognition at large standoffs with small dataset

被引:36
作者
Jalali, Amin [1 ]
Mallipeddi, Rammohan [1 ]
Lee, Minho [1 ]
机构
[1] Kyungpook Natl Univ, Sch Elect Engn, 1370 Sankyuk Dong, Taegu 702701, South Korea
基金
新加坡国家研究基金会;
关键词
Convolutional neural network; Gradient descent; Input-output mapping sensitivity error back; propagation; Face recognition at long distances with; small dataset; Sensitivity in cost function; Deep neural structures;
D O I
10.1016/j.eswa.2017.06.025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a sensitive convolutional neural network which incorporates sensitivity term in the cost function of Convolutional Neural Network (CNN) to emphasize on the slight variations and high frequency components in highly blurred input image samples. The proposed cost function in CNN has a sensitivity part in which the conventional error is divided by the derivative of the activation function, and subsequently the total error is minimized by the gradient descent method during the learning process. Due to the proposed sensitivity term, the data samples at the decision boundaries appear more on the middle band or the high gradient part of the activation function. This highlights the slight changes in the highly blurred input images enabling better feature extraction resulting in better generalization and improved classification performance in the highly blurred images. To study the effect of the proposed sensitivity term, experiments were performed for the face recognition task on small dataset of facial images at different long standoffs in both night-time and day-time modalities. (c) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:304 / 315
页数:12
相关论文
共 26 条
[11]   Novel input and output mapping-sensitive error back propagation learning algorithm for detecting small input feature variations [J].
Jung, Chanwoong ;
Kim, Cheol-Su ;
Ban, Sang-Woo ;
Hwang, Il-Kyu ;
Lee, Minho .
NEURAL COMPUTING & APPLICATIONS, 2012, 21 (04) :705-713
[12]   Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition [J].
Jung, Heechul ;
Lee, Sihaeng ;
Yim, Junho ;
Park, Sunjeong ;
Kim, Junmo .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2983-2991
[13]   Nighttime face recognition at large standoff: Cross-distance and cross-spectral matching [J].
Kang, Dongoh ;
Han, Hu ;
Jain, Anil K. ;
Lee, Seong-Whan .
PATTERN RECOGNITION, 2014, 47 (12) :3750-3766
[14]   Deep Learning on Small Datasets using Online Image Search [J].
Kolar, Martin ;
Hradis, Michal ;
Zemcik, Pavel .
32ND SPRING CONFERENCE ON COMPUTER GRAPHICS (SCCG 2016), 2016, :87-93
[15]  
Krizhevsky A., 2017, COMMUN ACM, V60, P84, DOI DOI 10.1145/3065386
[16]  
LeCun Y, 2004, PROC CVPR IEEE, P97
[17]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324
[18]   Neural network-based face detection [J].
Rowley, HA ;
Baluja, S ;
Kanade, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1998, 20 (01) :23-38
[19]   Validation of Nonlinear PCA [J].
Scholz, Matthias .
NEURAL PROCESSING LETTERS, 2012, 36 (01) :21-30
[20]  
Simard PY, 2003, PROC INT CONF DOC, P958