Learning Degradation-Invariant Representation for Robust Real-World Person Re-Identification

被引:15
作者
Huang, Yukun [1 ]
Fu, Xueyang [1 ]
Li, Liang [2 ]
Zha, Zheng-Jun [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Person Re-ID; Representation learning; Vision in bad weather; Deep learning; Low-light image enhancement; ENHANCEMENT;
D O I
10.1007/s11263-022-01666-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (Re-ID) in real-world scenarios suffers from various degradations, e.g., low resolution, weak lighting, and bad weather. These degradations hinders identity feature learning and significantly degrades Re-ID performance. To address these issues, in this paper, we propose a degradation invariance learning framework for robust person Re-ID. Concretely, we first design a content-degradation feature disentanglement strategy to capture and isolate task-irrelevant features contained in the degraded image. Then, to avoid the catastrophic forgetting problem, we introduce a memory replay algorithm to further consolidate invariance knowledge learned from the previous pre-training to improve subsequent identity feature learning. In this way, our framework is able to continuously maintain degradation-invariant priors from one or more datasets to improve the robustness of identity features, achieving state-of-the-art Re-ID performance on several challenging real-world benchmarks with a unified model. Furthermore, the proposed framework can be extended to low-level image processing, e.g., low-light image enhancement, demonstrating the potential of our method as a general framework for the various vision tasks. Code and trained models will be available at: https://github.com/hyk1996/Degradati on-Invariant-Re-D-pytorch.
引用
收藏
页码:2770 / 2796
页数:27
相关论文
共 113 条
[1]   Domain Adaptation Through Synthesis for Unsupervised Person Re-identification [J].
Bak, Slawomir ;
Carr, Peter ;
Lalonde, Jean-Francois .
COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 :193-209
[2]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[3]  
Burgess C. P., 2018, ARXIV
[4]   Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Model [J].
Cai, Jianrui ;
Zeng, Hui ;
Yong, Hongwei ;
Cao, Zisheng ;
Zhang, Lei .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3086-3095
[5]  
Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709
[6]  
Chen M., 2021, arXiv
[7]  
Chen X, 2016, ADV NEUR IN, V29
[8]  
Chen YC, 2019, AAAI CONF ARTIF INTE, P8215
[9]   PSD: Principled Synthetic-to-Real Dehazing Guided by Physical Priors [J].
Chen, Zeyuan ;
Wang, Yangchao ;
Yang, Yang ;
Liu, Dong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :7176-7185
[10]   Custom Pictorial Structures for Re-identification [J].
Cheng, Dong Seon ;
Cristani, Marco ;
Stoppa, Michele ;
Bazzani, Loris ;
Murino, Vittorio .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2011, 2011,