Quality-Aware Part Models for Occluded Person Re-Identification

被引:47
作者
Wang, Pengfei [1 ]
Ding, Changxing [1 ,2 ]
Shao, Zhiyin [1 ]
Hong, Zhibin [3 ]
Zhang, Shengli [4 ]
Tao, Dacheng [5 ]
机构
[1] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou 510000, Peoples R China
[2] Pazhou Lab, Guangzhou 510330, Peoples R China
[3] Baidu Inc, Dept Comp Vis Technol VIS, Shenzhen 518000, Peoples R China
[4] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen 518052, Peoples R China
[5] JD com, JD Explore Acad, Beijing 100176, Peoples R China
基金
中国国家自然科学基金;
关键词
Person re-identification; occlusion; attention models; NETWORK;
D O I
10.1109/TMM.2022.3156282
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Occlusion poses a major challenge for person re-identification (ReID). Existing approaches typically rely on outside tools to infer visible body parts, which may be suboptimal in terms of both computational efficiency and ReID accuracy. In particular, they may fail when facing complex occlusions, such as those between pedestrians. Accordingly, in this paper, we propose a novel method named Quality-aware Part Models (QPM) for occlusion-robust ReID. First, we propose to jointly learn part features and predict part quality scores. As no quality annotation is available, we introduce a strategy that automatically assigns low scores to occluded body parts, thereby weakening the impact of occluded body parts on ReID results. Second, based on the predicted part quality scores, we propose a novel identity-aware spatial attention (ISA) module. In this module, a coarse identity-aware feature is utilized to highlight pixels of the target pedestrian, so as to handle the occlusion between pedestrians. Third, we design an adaptive and efficient approach for generating global features from common non-occluded regions with respect to each image pair. This design is crucial, but is often ignored by existing methods. QPM has three key advantages: 1) it does not rely on any outside tools in either the training or inference stages; 2) it handles occlusions caused by both objects and other pedestrians; 3) it is highly computationally efficient. Experimental results on four popular databases for occluded ReID demonstrate that QPM consistently outperforms state-of-the-art methods by significant margins. The code of QPM is available at https://github.com/Wang-pengfei/QPM.
引用
收藏
页码:3154 / 3165
页数:12
相关论文
共 75 条
[1]   Multi-Level Factorisation Net for Person Re-Identification [J].
Chang, Xiaobin ;
Hospedales, Timothy M. ;
Xiang, Tao .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2109-2118
[2]   Person Re-Identification by Deep Learning Multi-Scale Representations [J].
Chen, Yanbei ;
Zhu, Xiatian ;
Gong, Shaogang .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :2590-2600
[3]   Multi-Task Learning With Coarse Priors for Robust Part-Aware Person Re-Identification [J].
Ding, Changxing ;
Wang, Kan ;
Wang, Pengfei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (03) :1474-1488
[4]  
Gao S, 2020, PROC CVPR IEEE, P11741, DOI 10.1109/CVPR42600.2020.01176
[5]   DCR: A Unified Framework for Holistic/Partial Person ReID [J].
Gao, Zan ;
Gao, Lishuai ;
Zhang, Hua ;
Cheng, Zhiyong ;
Hong, Richang ;
Chen, Shengyong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :3332-3345
[6]   LAG-Net: Multi-Granularity Network for Person Re-Identification via Local Attention System [J].
Gong, Xun ;
Yao, Zu ;
Li, Xin ;
Fan, Yueqiao ;
Luo, Bin ;
Fan, Jianfeng ;
Lao, Boji .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :217-229
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]  
He LX, 2018, Arxiv, DOI arXiv:1810.07399
[9]  
He LX, 2020, Img Proc Comp Vis Re, V12373, P357, DOI 10.1007/978-3-030-58604-1_22
[10]   Foreground-aware Pyramid Reconstruction for Alignment-free Occluded Person Re-identification [J].
He, Lingxiao ;
Wang, Yinggang ;
Liu, Wu ;
Zhao, He ;
Sun, Zhenan ;
Feng, Jiashi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8449-8458