Face re-identification challenge: Are face recognition models good enough?

被引:18
作者
Cheng, Zhiyi [1 ]
Zhu, Xiatian [3 ]
Gong, Shaogang [2 ]
机构
[1] Queen Mary Univ London, London, England
[2] Queen Mary Univ London, Visual Computat, London, England
[3] Vis Semant Ltd, London, England
基金
“创新英国”项目;
关键词
Face re-identification; Surveillance facial imagery; Low-resolution; Super-resolution; Open-set matching; Deep learning; Face recognition; NEURAL-NETWORK; SINGLE-IMAGE; SUPERRESOLUTION; REPRESENTATION; HALLUCINATION; PATTERNS;
D O I
10.1016/j.patcog.2020.107422
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face re-identification (Re-ID) aims to track the same individuals over space and time with subtle identity class information in automatically detected face images captured by unconstrained surveillance camera views. Despite significant advances of face recognition systems for constrained social media facial images, face Re-ID is more challenging due to poor-quality surveillance face imagery data and remains under-studied. However, solving this problem enables a wide range of practical applications, ranging from law enforcement and information security to business, entertainment and e-commerce. To facilitate more studies on face Re-ID towards practical and robust solutions, a true large scale Surveillance Face Re-ID benchmark (SurvFace) is introduced, characterised by natively low-resolution, motion blur, uncontrolled poses, varying occlusion, poor illumination, and background clutters. This new benchmark is the largest and more importantly the only true surveillance face Re-ID dataset to our best knowledge, where facial images are captured and detected under realistic surveillance scenarios. We show that the current state-of-the-art FR methods are surprisingly poor for face Re-ID. Besides, face Re-ID is generally more difficult in an open-set setting as naturally required in surveillance scenarios, owing to a large number of non-target people (distractors) appearing in open ended scenes. Moreover, the low-resolution problem inherent to surveillance facial imagery is investigated. Finally, we discuss open research problems that need to be solved in order to overcome the under-studied face Re-ID problem. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 131 条
[41]   Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features [J].
Gray, Douglas ;
Tao, Hai .
COMPUTER VISION - ECCV 2008, PT I, PROCEEDINGS, 2008, 5302 :262-275
[42]   SCface - surveillance cameras face database [J].
Grgic, Mislav ;
Delac, Kresimir ;
Grgic, Sonja .
MULTIMEDIA TOOLS AND APPLICATIONS, 2011, 51 (03) :863-879
[43]   Multi-PIE [J].
Gross, Ralph ;
Matthews, Iain ;
Cohn, Jeffrey ;
Kanade, Takeo ;
Baker, Simon .
IMAGE AND VISION COMPUTING, 2010, 28 (05) :807-813
[44]  
Grother P., 2014, NIST INTERAGENCY REP, P14
[45]  
Günther M, 2017, 2017 IEEE INTERNATIONAL JOINT CONFERENCE ON BIOMETRICS (IJCB), P697, DOI 10.1109/BTAS.2017.8272759
[46]   Eigenface-domain super-resolution for face recognition [J].
Gunturk, BK ;
Batur, AU ;
Altunbasak, Y ;
Hayes, MH ;
Mersereau, RM .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (05) :597-606
[47]   MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition [J].
Guo, Yandong ;
Zhang, Lei ;
Hu, Yuxiao ;
He, Xiaodong ;
Gao, Jianfeng .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :87-102
[48]  
Gupta S., 2019, CONSUM COMM NETWORK, P1
[49]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[50]   Deformable face net for pose invariant face recognition [J].
He, Mingjie ;
Zhang, Jie ;
Shan, Shiguang ;
Kan, Meina ;
Chen, Xilin .
PATTERN RECOGNITION, 2020, 100