Part-Based Representation Enhancement for Occluded Person Re-Identification

被引:32
作者
Yan, Gang [1 ]
Wang, Zijin [1 ]
Geng, Shuze [2 ]
Yu, Yang [1 ]
Guo, Yingchun [1 ]
机构
[1] Hebei Univ Technol, Schoolof Artificial Intelligence, Tianjin 300401, Peoples R China
[2] Tianjin Univ Technol & Educ, Sch Informat Technol & Engn, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature reconstruction; person re-identification; feature fusion; occlusion problem; NETWORK;
D O I
10.1109/TCSVT.2023.3241764
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Retrieving an occluded pedestrian remains a challenging problem in person re-identification (re-id). Most existing methods utilize external detectors to disentangle the visible body parts. However, these methods are unstable due to domain bias and consume numerous computing resources. In this paper, we propose a novel and lightweight Part-based Representation Enhancement (PRE) network for occluded re-id that takes full advantages of the local correlations to aggregate distinctive information for local features without relying on auxiliary detectors. First, according to the information qualities of different body parts, we design a reasonable partition strategy to obtain the local features. Next, a Partial Relationship Aggregation (PRA) module is developed to self-mine the visibility of the body and construct a correlation matrix for collecting the information related to pre-defined classes. Following this, we propose an Inter-part Omnibearing Fusion (IOF) module that leverages the occlusion-suppressed class features to enhance the distinctiveness of the local features via feature completion and reverse fusion strategies. During the testing phase, the global and reconstructed local features are concatenated together for re-id without a complex visible region matching algorithm. Extensive experiments on occluded, partial, and holistic re-id benchmarks demonstrate the superiority of PRE over state-of-the-art methods in terms of accuracy and model complexity.
引用
收藏
页码:4217 / 4231
页数:15
相关论文
共 75 条
[11]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[12]  
He LX, 2018, Arxiv, DOI arXiv:1810.07399
[13]   Foreground-aware Pyramid Reconstruction for Alignment-free Occluded Person Re-identification [J].
He, Lingxiao ;
Wang, Yinggang ;
Liu, Wu ;
Zhao, He ;
Sun, Zhenan ;
Feng, Jiashi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8449-8458
[14]   Deep Spatial Feature Reconstruction for Partial Person Re-identification: Alignment-free Approach [J].
He, Lingxiao ;
Liang, Jian ;
Li, Haiqing ;
Sun, Zhenan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7073-7082
[15]  
Hermans A, 2017, Arxiv, DOI arXiv:1703.07737
[16]   Feature Completion for Occluded Person Re-Identification [J].
Hou, Ruibing ;
Ma, Bingpeng ;
Chang, Hong ;
Gu, Xinqian ;
Shan, Shiguang ;
Chen, Xilin .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) :4894-4912
[17]   Interaction-and-Aggregation Network for Person Re-identification [J].
Hou, Ruibing ;
Ma, Bingpeng ;
Chang, Hong ;
Gu, Xinqian ;
Shan, Shiguang ;
Chen, Xilin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9309-9318
[18]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[19]   Multiscale Omnibearing Attention Networks for Person Re-Identification [J].
Huang, Yewen ;
Lian, Sicheng ;
Hu, Haifeng ;
Chen, Dihu ;
Su, Tao .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) :1790-1803
[20]  
Jia MX, 2021, AAAI CONF ARTIF INTE, V35, P1673