Deep residual network for face sketch synthesis

被引:9
作者
Radman, Abduljalil [1 ]
Sallam, Amer [1 ]
Suandi, Shahrel Azmin [2 ]
机构
[1] Taiz Univ, Alsaeed Fac Engn & Informat Technol, Taizi, Yemen
[2] Univ Sains Malaysia, Sch Elect & Elect Engn, Intelligent Biometr Grp, Nibong Tebal 14300, Pulau Pinang, Malaysia
关键词
Face sketch synthesis; Deep learning; Residual learning; Convolutional neural networks; FIELDS;
D O I
10.1016/j.eswa.2021.115980
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face sketch synthesis plays a crucial role in face recognition for law enforcement applications. However, the current face sketch synthesis approaches generate sketches from photos based on a model trained by a certain database that is usually collected from individuals of the same ethnicity, and therefore such sketches merely inherit distinct facial distributions (shape and texture) of this database. This also makes such models inapplicable for real-world applications which mainly include multiple photo variations such as pose, lighting, skin color, and ethnic origin. In this paper, a unified face sketch synthesis model considering ethnicity issue as well as photo variations is proposed. A new deep learning scheme is designed to handle the generic visual representation and global structure of the face. Towards the final objective, the recent success of deep residual blocks is exploited and incorporated into a plain feedforward network, termed as DResNet, to learn a regression model for face sketch synthesis. A heterogeneous database containing photos with lighting, ethnicity, hair and skin variations is utilized for training the DResNet model. Extensive subjective and objective evaluations showed the superiority of the proposed DResNet method on state-of-the-art face sketch synthesis methods. Experimental results also demonstrated that the proposed DResNet method can be generalized to face sketch synthesis for real-world applications.
引用
收藏
页数:10
相关论文
共 36 条
[1]  
[Anonymous], 1998, AR FACE DATABASE
[2]  
[Anonymous], 2018, IEEE T CIRC SYST VID, DOI DOI 10.1109/TCSVT.2017.2709465
[3]   A new LDA-based face recognition system which can solve the small sample size problem [J].
Chen, LF ;
Liao, HYM ;
Ko, MT ;
Lin, JC ;
Yu, GJ .
PATTERN RECOGNITION, 2000, 33 (10) :1713-1726
[4]   Active appearance models [J].
Cootes, TF ;
Edwards, GJ ;
Taylor, CJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (06) :681-685
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]  
Ioffe S, 2015, PR MACH LEARN RES, V37, P448
[7]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[8]   Graph-Regularized Locality-Constrained Joint Dictionary and Residual Learning for Face Sketch Synthesis [J].
Jiang, Junjun ;
Yu, Yi ;
Wang, Zheng ;
Liu, Xianming ;
Ma, Jiayi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (02) :628-641
[9]   A modified convolutional neural network for face sketch synthesis [J].
Jiao, Licheng ;
Zhang, Sibo ;
Li, Lingling ;
Liu, Fang ;
Ma, Wenping .
PATTERN RECOGNITION, 2018, 76 :125-136
[10]   A framework for suspect face retrieval using linguistic descriptions [J].
Khan, Mohd Aamir ;
Jalal, Anand Singh .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 141