Face image retrieval based on shape and texture feature fusion

被引:3
作者
Lu Z. [1 ]
Yang J. [1 ]
Liu Q. [1 ]
机构
[1] School of Information and Control Engineering, Nanjing University of Information Science and Technology, Nanjing
基金
英国科研创新办公室;
关键词
coarse-to-fine; convolutional neural networks (CNNs); face retrieval;
D O I
10.1007/s41095-017-0091-7
中图分类号
TN911 [通信理论];
学科分类号
081002 ;
摘要
Humongous amounts of data bring various challenges to face image retrieval. This paper proposes an efficient method to solve those problems. Firstly, we use accurate facial landmark locations as shape features. Secondly, we utilise shape priors to provide discriminative texture features for convolutional neural networks. These shape and texture features are fused to make the learned representation more robust. Finally, in order to increase efficiency, a coarse-tofine search mechanism is exploited to efficiently find similar objects. Extensive experiments on the CASIAWebFace, MSRA-CFW, and LFW datasets illustrate the superiority of our method. © 2017, The Author(s).
引用
收藏
页码:359 / 368
页数:9
相关论文
共 35 条
[1]  
Chan C.H., Tahir M.A., Kittler J., Pietikainen M., Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors, IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 5, pp. 1164-1177, (2013)
[2]  
Wu Z., Ke Q., Sun J., Shum H.-Y., Scalable face image retrieval with identity-based quantization and multireference reranking, IEEE Transactions on Pattern Analysis and Machine Intelligence, 33, 10, pp. 1991-2001, (2011)
[3]  
Bach J.R., Paul S., Jain R., A visual information management system for the interactive retrieval of faces, IEEE Transactions on Knowledge and Data Engineering, 5, 4, pp. 619-628, (1993)
[4]  
Eickeler S., Face database retrieval using pseudo 2D hidden Markov models, Proceedings of the 5th IEEE International Conference on Automatic Face Gesture Recognition, pp. 58-63, (2002)
[5]  
Gudivada V.N., Raghavan V.V., Modeling and retrieving images by content, Information Processing & Management, 33, 4, pp. 427-452, (1997)
[6]  
Wang X., Zhang C., Zhang Z., Boosted multitask learning for face verification with applications to web image and video search, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 142-149, (2009)
[7]  
Ojala T., Pietikainen M., Maenpaa T., Multiresolution gray-scale and rotation invariant texture classification with local binary patterns, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 7, pp. 971-987, (2002)
[8]  
Parkhi O.M., Vedaldi A., Zisserman A., Deep face recognition, Proceedings of the British Machine Vision Conference, (2015)
[9]  
Schroff F., Kalenichenko D., Philbin J., FaceNET: A unified embedding for face recognition and clustering, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 815-823, (2015)
[10]  
Sun Y., Chen Y., Wang X., Tang X., Deep learning face representation by joint identification-verification, Proceedings of the Advances in Neural Information Processing Systems 27, pp. 1988-1996, (2014)