Part-Based Representation Enhancement for Occluded Person Re-Identification

被引:32
作者
Yan, Gang [1 ]
Wang, Zijin [1 ]
Geng, Shuze [2 ]
Yu, Yang [1 ]
Guo, Yingchun [1 ]
机构
[1] Hebei Univ Technol, Schoolof Artificial Intelligence, Tianjin 300401, Peoples R China
[2] Tianjin Univ Technol & Educ, Sch Informat Technol & Engn, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature reconstruction; person re-identification; feature fusion; occlusion problem; NETWORK;
D O I
10.1109/TCSVT.2023.3241764
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Retrieving an occluded pedestrian remains a challenging problem in person re-identification (re-id). Most existing methods utilize external detectors to disentangle the visible body parts. However, these methods are unstable due to domain bias and consume numerous computing resources. In this paper, we propose a novel and lightweight Part-based Representation Enhancement (PRE) network for occluded re-id that takes full advantages of the local correlations to aggregate distinctive information for local features without relying on auxiliary detectors. First, according to the information qualities of different body parts, we design a reasonable partition strategy to obtain the local features. Next, a Partial Relationship Aggregation (PRA) module is developed to self-mine the visibility of the body and construct a correlation matrix for collecting the information related to pre-defined classes. Following this, we propose an Inter-part Omnibearing Fusion (IOF) module that leverages the occlusion-suppressed class features to enhance the distinctiveness of the local features via feature completion and reverse fusion strategies. During the testing phase, the global and reconstructed local features are concatenated together for re-id without a complex visible region matching algorithm. Extensive experiments on occluded, partial, and holistic re-id benchmarks demonstrate the superiority of PRE over state-of-the-art methods in terms of accuracy and model complexity.
引用
收藏
页码:4217 / 4231
页数:15
相关论文
共 75 条
[1]   Adversarial Metric Attack and Defense for Person Re-Identification [J].
Bai, Song ;
Li, Yingwei ;
Zhou, Yuyin ;
Li, Qizhu ;
Torr, Philip H. S. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (06) :2119-2126
[2]   Salience-Guided Cascaded Suppression Network for Person Re-identification [J].
Chen, Xuesong ;
Fu, Canmiao ;
Zhao, Yong ;
Zheng, Feng ;
Song, Jingkuan ;
Ji, Rongrong ;
Yang, Yi .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3297-3307
[3]   Person Re-Identification by Multi-Channel Parts-Based CNN with Improved Triplet Loss Function [J].
Cheng, De ;
Gong, Yihong ;
Zhou, Sanping ;
Wang, Jinjun ;
Zheng, Nanning .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1335-1344
[4]   Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification [J].
Deng, Weijian ;
Zheng, Liang ;
Ye, Qixiang ;
Kang, Guoliang ;
Yang, Yi ;
Jiao, Jianbin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :994-1003
[5]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[6]   SCPNet: Spatial-Channel Parallelism Network for Joint Holistic and Partial Person Re-identification [J].
Fan, Xing ;
Luo, Hao ;
Zhang, Xuan ;
He, Lingxiao ;
Zhang, Chi ;
Jiang, Wei .
COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 :19-34
[7]   RMPE: Regional Multi-Person Pose Estimation [J].
Fang, Hao-Shu ;
Xie, Shuqin ;
Tai, Yu-Wing ;
Lu, Cewu .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2353-2362
[8]   Unsupervised Pre-training for Person Re-identification [J].
Fu, Dengpan ;
Chen, Dongdong ;
Bao, Jianmin ;
Yang, Hao ;
Yuan, Lu ;
Zhang, Lei ;
Li, Houqiang ;
Chen, Dong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14745-14754
[9]  
Fu Y, 2019, AAAI CONF ARTIF INTE, P8295
[10]   Pose-guided Visible Part Matching for Occluded Person ReID [J].
Gao, Shang ;
Wang, Jingya ;
Lu, Huchuan ;
Liu, Zimo .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11741-11749