Face re-identification challenge: Are face recognition models good enough?

被引:16
作者
Cheng, Zhiyi [1 ]
Zhu, Xiatian [3 ]
Gong, Shaogang [2 ]
机构
[1] Queen Mary Univ London, London, England
[2] Queen Mary Univ London, Visual Computat, London, England
[3] Vis Semant Ltd, London, England
基金
“创新英国”项目;
关键词
Face re-identification; Surveillance facial imagery; Low-resolution; Super-resolution; Open-set matching; Deep learning; Face recognition; NEURAL-NETWORK; SINGLE-IMAGE; SUPERRESOLUTION; REPRESENTATION; HALLUCINATION; PATTERNS;
D O I
10.1016/j.patcog.2020.107422
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face re-identification (Re-ID) aims to track the same individuals over space and time with subtle identity class information in automatically detected face images captured by unconstrained surveillance camera views. Despite significant advances of face recognition systems for constrained social media facial images, face Re-ID is more challenging due to poor-quality surveillance face imagery data and remains under-studied. However, solving this problem enables a wide range of practical applications, ranging from law enforcement and information security to business, entertainment and e-commerce. To facilitate more studies on face Re-ID towards practical and robust solutions, a true large scale Surveillance Face Re-ID benchmark (SurvFace) is introduced, characterised by natively low-resolution, motion blur, uncontrolled poses, varying occlusion, poor illumination, and background clutters. This new benchmark is the largest and more importantly the only true surveillance face Re-ID dataset to our best knowledge, where facial images are captured and detected under realistic surveillance scenarios. We show that the current state-of-the-art FR methods are surprisingly poor for face Re-ID. Besides, face Re-ID is generally more difficult in an open-set setting as naturally required in surveillance scenarios, owing to a large number of non-target people (distractors) appearing in open ended scenes. Moreover, the low-resolution problem inherent to surveillance facial imagery is investigated. Finally, we discuss open research problems that need to be solved in order to overcome the under-studied face Re-ID problem. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 131 条
[1]   2D and 3D face recognition: A survey [J].
Abate, Andrea F. ;
Nappi, Michele ;
Riccio, Daniel ;
Sabatino, Gabriele .
PATTERN RECOGNITION LETTERS, 2007, 28 (14) :1885-1906
[2]   Face description with local binary patterns:: Application to face recognition [J].
Ahonen, Timo ;
Hadid, Abdenour ;
Pietikainen, Matti .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :2037-2041
[3]  
[Anonymous], 2017, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2017.244
[4]  
Baltieri D., 2011, P 2011 JOINT ACM WOR, P59, DOI DOI 10.1145/2072572.2072590
[5]  
Baltieri D, 2011, LECT NOTES COMPUT SC, V6978, P197, DOI 10.1007/978-3-642-24085-0_21
[6]  
Bansal A., 2016, UMDFACES ANNO TATED
[7]   The Do's and Don'ts for CNN-based Face Verification [J].
Bansal, Ankan ;
Castillo, Carlos ;
Ranjan, Rajeev ;
Chellappa, Rama .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :2545-2554
[8]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[9]   Towards Open Set Deep Networks [J].
Bendale, Abhijit ;
Boult, Terrance E. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1563-1572
[10]  
Bendale A, 2015, PROC CVPR IEEE, P1893, DOI 10.1109/CVPR.2015.7298799