When Person Re-identification Meets Changing Clothes

被引:96
作者
Wan, Fangbin [1 ,4 ]
Wu, Yang [2 ,6 ]
Qian, Xuelin [3 ,4 ]
Chen, Yixiong [1 ,4 ]
Fu, Yanwei [1 ,4 ,5 ]
机构
[1] Fudan Univ, Sch Data Sci, Shanghai, Peoples R China
[2] Kyoto Univ, Kyoto, Japan
[3] Fudan Univ, Sch Comp Sci, Shanghai, Peoples R China
[4] Fudan Univ, Shanghai Key Lab Intelligent Informat Proc, Shanghai, Peoples R China
[5] Fudan Univ, MOE Frontiers Ctr Brain Sci, Shanghai, Peoples R China
[6] Kyoto Univ, Grad Sch Informat, Dept Intelligenai Sci & Technol, Kyoto, Japan
来源
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020) | 2020年
关键词
D O I
10.1109/CVPRW50498.2020.00423
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (ReID) is now an active research topic for AI-based video surveillance applications such as specific person search, but the practical issue that the target person(s) may change clothes (clothes inconsistency problem) has been overlooked for long. For the first time, this paper systematically studies this problem. We first overcome the difficulty of lack of suitable dataset, by collecting a small yet representative real dataset for testing whilst building a large realistic synthetic dataset for training and deeper studies. Facilitated by our new datasets, we are able to conduct various interesting new experiments for studying the influence of clothes inconsistency. We find that changing clothes makes ReID a much harder problem in the sense of bringing difficulties to learning effective representations and also challenges the generalization ability of previous ReID models to identify persons with unseen (new) clothes. Representative existing ReID models are adopted to show informative results on such a challenging setting, and we also provide some preliminary efforts on improving the robustness of existing models on handling the clothes inconsistency issue in the data. We believe that this study can be inspiring and helpful for encouraging more researches in this direction. The dataset is available on the project website: https://wanfb.github.io/dataset.html. [GRAPHICS] .
引用
收藏
页码:3620 / 3628
页数:9
相关论文
共 31 条
[1]   Seeing 3D chairs: exemplar part-based 2D-3D alignment using a large dataset of CAD models [J].
Aubry, Mathieu ;
Maturana, Daniel ;
Efros, Alexei A. ;
Russell, Bryan C. ;
Sivic, Josef .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3762-3769
[2]   Domain Adaptation Through Synthesis for Unsupervised Person Re-identification [J].
Bak, Slawomir ;
Carr, Peter ;
Lalonde, Jean-Francois .
COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 :193-209
[3]   Looking beyond appearances: Synthetic training data for deep CNNs in re identification [J].
Barbosa, Igor Barros ;
Cristani, Marco ;
Caputo, Barbara ;
Rognhaugen, Aleksander ;
Theoharis, Theoharis .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 167 :50-62
[4]  
Barbosa IB, 2012, LECT NOTES COMPUT SC, V7583, P433, DOI 10.1007/978-3-642-33863-2_43
[5]  
Busto P. P., 2015, BMVC, P14
[6]   Learning to Detect and Track Visible and Occluded Body Joints in a Virtual World [J].
Fabbri, Matteo ;
Lanzi, Fabio ;
Calderara, Simone ;
Palazzi, Andrea ;
Vezzani, Roberto ;
Cucchiara, Rita .
COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 :450-466
[7]   Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features [J].
Gray, Douglas ;
Tao, Hai .
COMPUTER VISION - ECCV 2008, PT I, PROCEEDINGS, 2008, 5302 :262-275
[8]   MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognition [J].
Guo, Yandong ;
Zhang, Lei ;
Hu, Yuxiao ;
He, Xiaodong ;
Gao, Jianfeng .
COMPUTER VISION - ECCV 2016, PT III, 2016, 9907 :87-102
[9]  
Hattori H, 2015, PROC CVPR IEEE, P3819, DOI 10.1109/CVPR.2015.7299006
[10]  
He KM, 2017, IEEE I CONF COMP VIS, P2980, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]