Learning Degradation-Invariant Representation for Robust Real-World Person Re-Identification

被引:15
作者
Huang, Yukun [1 ]
Fu, Xueyang [1 ]
Li, Liang [2 ]
Zha, Zheng-Jun [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Person Re-ID; Representation learning; Vision in bad weather; Deep learning; Low-light image enhancement; ENHANCEMENT;
D O I
10.1007/s11263-022-01666-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (Re-ID) in real-world scenarios suffers from various degradations, e.g., low resolution, weak lighting, and bad weather. These degradations hinders identity feature learning and significantly degrades Re-ID performance. To address these issues, in this paper, we propose a degradation invariance learning framework for robust person Re-ID. Concretely, we first design a content-degradation feature disentanglement strategy to capture and isolate task-irrelevant features contained in the degraded image. Then, to avoid the catastrophic forgetting problem, we introduce a memory replay algorithm to further consolidate invariance knowledge learned from the previous pre-training to improve subsequent identity feature learning. In this way, our framework is able to continuously maintain degradation-invariant priors from one or more datasets to improve the robustness of identity features, achieving state-of-the-art Re-ID performance on several challenging real-world benchmarks with a unified model. Furthermore, the proposed framework can be extended to low-level image processing, e.g., low-light image enhancement, demonstrating the potential of our method as a general framework for the various vision tasks. Code and trained models will be available at: https://github.com/hyk1996/Degradati on-Invariant-Re-D-pytorch.
引用
收藏
页码:2770 / 2796
页数:27
相关论文
共 113 条
[11]   Inter-Task Association Critic for Cross-Resolution Person Re-Identification [J].
Cheng, Zhiyi ;
Dong, Qi ;
Gong, Shaogang ;
Zhu, Xiatian .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2602-2612
[12]  
Choksi Bhavin, 2021, ADV NEUR IN, V34
[13]   Multi-Scale Boosted Dehazing Network with Dense Feature Fusion [J].
Dong, Hang ;
Pan, Jinshan ;
Xiang, Lei ;
Hu, Zhe ;
Zhang, Xinyi ;
Wang, Fei ;
Yang, Ming-Hsuan .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2154-2164
[14]  
Ge Y., 2018, Advances in Neural Information Processing Systems, P1222
[15]  
Ge Y., 2021, INT C LEARNING REPRE
[16]   A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs [J].
George, Dileep ;
Lehrach, Wolfgang ;
Kansky, Ken ;
Lazaro-Gredilla, Miguel ;
Laan, Christopher ;
Marthi, Bhaskara ;
Lou, Xinghua ;
Meng, Zhaoshi ;
Liu, Yi ;
Wang, Huayan ;
Lavin, Alex ;
Phoenix, D. Scott .
SCIENCE, 2017, 358 (6368)
[17]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[18]   Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features [J].
Gray, Douglas ;
Tao, Hai .
COMPUTER VISION - ECCV 2008, PT I, PROCEEDINGS, 2008, 5302 :262-275
[19]  
Gregor K, 2015, PR MACH LEARN RES, V37, P1462
[20]  
Gulrajani I., 2017, ARXIV