Multi deep invariant feature learning for cross-resolution person re-identification

被引:0
作者
Zhang, Weicheng [1 ,2 ]
Xiong, Shuhua [1 ]
He, Xiaohai [1 ]
Wu, Xiaohong [1 ]
He, Jie [2 ]
Chen, Honggang [1 ,3 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu 610065, Peoples R China
[2] Wuzhou Univ, Guangxi Key Lab Machine Vis & Intelligent Control, Wuzhou 543002, Peoples R China
[3] Yunan Univ, Yunnan Key Lab Software Engn, Kunming 650600, Peoples R China
基金
中国国家自然科学基金;
关键词
Cross-resolution person re-identification; Invariant feature learning; Feature reconstruction; Dual-stream input; Deep learning;
D O I
10.1016/j.ipm.2024.103764
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Person re -identification (Re -ID) is focused on identifying and matching the same pedestrian when captured across various surveillance cameras. However, variations in camera performance and the distances between pedestrians and cameras may result in capturing images of the same person at different resolutions. This specific issue, referred to as cross -resolution person re -identification (CRReID), presents considerable difficulties in achieving accurate person ReID. To address this issue, we propose a Multi -level and scale Deep Invariant Feature learning Framework (MDIFF), which effectively tackles the problem of cross -resolution person matching. Our MDIFF reconstructs person features at the shallow layers to alleviate information gaps and extracts resolution -invariant features at the deep layers for cross -resolution person matching. First, to mitigate information loss in resolution -invariant features, we propose a Dual Input Feature Reconstruction (DIFR) structure incorporating dual -stream input and a lightweight decoder, constrained by degradation loss and image reconstruction loss. Second, we propose a Multi -level Global-Local feature Interaction and Fusion (MGLIF) module to enhance the invariant features of persons and obtain deep invariant representations, making the final representation more robust to resolution changes and more discriminative. Finally, to make the feature distribution of the same identity more compact across different resolutions, we propose a cross -resolution joint loss optimization strategy, including cross -resolution triplet loss, cross -resolution center loss, and identity loss. Our comprehensive experimental results demonstrate the superior performance and efficacy of our MDIFF, outperforming current stateof-the-art methods across various CRReID benchmark datasets. Our code is available at https: //github.com/MiSanl/MDIFF-for-CRReID.
引用
收藏
页数:18
相关论文
共 62 条
[11]  
Ge YX, 2018, ADV NEUR IN, V31
[12]   Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features [J].
Gray, Douglas ;
Tao, Hai .
COMPUTER VISION - ECCV 2008, PT I, PROCEEDINGS, 2008, 5302 :262-275
[13]   Adaptive super -resolution for person re-identification with low-resolution images [J].
Han, Ke ;
Huang, Yan ;
Song, Chunfeng ;
Wang, Liang ;
Tan, Tieniu .
PATTERN RECOGNITION, 2021, 114
[14]   Prediction and Recovery for Adaptive Low-Resolution Person Re-Identification [J].
Han, Ke ;
Huang, Yan ;
Chen, Zerui ;
Wang, Liang ;
Tan, Tieniu .
COMPUTER VISION - ECCV 2020, PT XXVI, 2020, 12371 :193-209
[15]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[16]   Learning Degradation-Invariant Representation for Robust Real-World Person Re-Identification [J].
Huang, Yukun ;
Fu, Xueyang ;
Li, Liang ;
Zha, Zheng-Jun .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (11) :2770-2796
[17]   Attack-Guided Perceptual Data Generation for Real-world Re-Identification [J].
Huang, Yukun ;
Fu, Xueyang ;
Zha, Zheng-Jun .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :215-224
[18]   Real-world Person Re-Identification via Degradation Invariance Learning [J].
Huang, Yukun ;
Zha, Zheng-Jun ;
Fu, Xueyang ;
Hong, Richang ;
Li, Liang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :14072-14082
[19]  
Jia MX, 2023, AAAI CONF ARTIF INTE, P998
[20]  
Jiao JN, 2018, AAAI CONF ARTIF INTE, P6967