HUMAN PARSING BASED ALIGNMENT WITH MULTI-TASK LEARNING FOR OCCLUDED PERSON RE-IDENTIFICATION

被引:33
作者
Huang, Houjing [1 ,2 ]
Chen, Xiaotang [1 ,2 ]
Huang, Kaiqi [1 ,2 ,3 ]
机构
[1] CASIA, CRISE, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
[3] CAS Ctr Excellence Brain Sci & Intelligence Techn, Beijing, Peoples R China
来源
2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME) | 2020年
基金
中国国家自然科学基金;
关键词
Person Re-identification; Partial; Occlusion; Human Parsing; Multi-task;
D O I
10.1109/icme46284.2020.9102789
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Person re-identification (ReID) has obtained great progress in recent years. However, the problem caused by occlusion, which is frequent under surveillance camera, is not sufficiently addressed. When human body is occluded, extracted features are flooded with background noise. Moreover, without knowing location and visibility of parts, directly matching partial images with others will cause misalignment. To tackle the issue, we propose a model named HPNet to extract part-level features and predict visibility of each part, based on human parsing. By extracting features from semantic part regions and perform comparison with consideration of visibility, our method not only reduces background noise but also achieves alignment. Furthermore, ReID and human parsing are learned in a multi-task manner, without the need for an extra part model during testing. In addition to being efficient, the performance of our model surpasses previous methods by a large margin under occlusion scenarios.
引用
收藏
页数:6
相关论文
共 19 条
[1]  
[Anonymous], 2018, CVPR
[2]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[3]  
Gray, 2007, PETS WORKSH
[4]   DensePose: Dense Human Pose Estimation In The Wild [J].
Guler, Riza Alp ;
Neverova, Natalia ;
Kokkinos, Lasonas .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7297-7306
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]   Foreground-aware Pyramid Reconstruction for Alignment-free Occluded Person Re-identification [J].
He, Lingxiao ;
Wang, Yinggang ;
Liu, Wu ;
Zhao, He ;
Sun, Zhenan ;
Feng, Jiashi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8449-8458
[7]   Deep Spatial Feature Reconstruction for Partial Person Re-identification: Alignment-free Approach [J].
He, Lingxiao ;
Liang, Jian ;
Li, Haiqing ;
Sun, Zhenan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7073-7082
[8]  
Hermans, 2017, DEFENSE TRIPLET LOSS
[9]   Focal Loss for Dense Object Detection [J].
Lin, Tsung-Yi ;
Goyal, Priya ;
Girshick, Ross ;
He, Kaiming ;
Dollar, Piotr .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2999-3007
[10]   Bag of Tricks and A Strong Baseline for Deep Person Re-identification [J].
Luo, Hao ;
Gu, Youzhi ;
Liao, Xingyu ;
Lai, Shenqi ;
Jiang, Wei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :1487-1495