Shallow-Deep Collaborative Learning for Unsupervised Visible-Infrared Person Re-Identification

被引:8
|
作者
Yang, Bin [1 ]
Chen, Jun [1 ]
Ye, Mang [1 ]
机构
[1] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Hubei Luojia Lab, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52733.2024.01596
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised visible-infrared person re-identification ( US-VI-ReID) centers on learning a cross-modality retrieval model without labels, reducing the reliance on expensive cross-modality manual annotation. Previous US-VIReID works gravitate toward learning cross-modality information with the deep features extracted from the ultimate layer. Nevertheless, interfered by the multiple discrepancies, solely relying on deep features is insufficient for accurately learning modality-invariant features, resulting in negative optimization. The shallow feature from the shallow layers contains nuanced detail information, which is critical for effective cross-modality learning but is disregarded regrettably by the existing methods. To address the above issues, we design a Shallow-Deep Collaborative Learning (SDCL) framework based on the transformer with shallow-deep contrastive learning, incorporating Collaborative Neighbor Learning (CNL) and Collaborative Ranking Association (CRA) module. Specifically, CNL unveils the intrinsic homogeneous and heterogeneous collaboration which are harnessed for neighbor alignment, enhancing the robustness in a dynamic manner. Furthermore, CRA associates the cross-modality labels with the ranking association between shallow and deep features, furnishing valuable supervision for cross-modality learning. Extensive experiments validate the superiority of our method, even outperforming certain supervised counterparts.
引用
收藏
页码:16870 / 16879
页数:10
相关论文
共 50 条
  • [1] Robust Duality Learning for Unsupervised Visible-Infrared Person Re-Identification
    Li, Yongxiang
    Sun, Yuan
    Qin, Yang
    Peng, Dezhong
    Peng, Xi
    Hu, Peng
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 1937 - 1948
  • [2] Towards Grand Unified Representation Learning for Unsupervised Visible-Infrared Person Re-Identification
    Bin Yang
    Chen, Jun
    Ye, Mang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 11035 - 11045
  • [3] Two-stage contrastive learning for unsupervised visible-infrared person re-identification
    Zou, Yuan
    Zhu, Pengxu
    Yang, Jianwei
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (06)
  • [4] Dual Consistency-Constrained Learning for Unsupervised Visible-Infrared Person Re-Identification
    Yang, Bin
    Chen, Jun
    Chen, Cuiqun
    Ye, Mang
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 1767 - 1779
  • [5] Image-text feature learning for unsupervised visible-infrared person re-identification
    Guo, Jifeng
    Pang, Zhiqi
    IMAGE AND VISION COMPUTING, 2025, 158
  • [6] Unveiling the Power of CLIP in Unsupervised Visible-Infrared Person Re-Identification
    Chen, Zhong
    Zhang, Zhizhong
    Tan, Xin
    Qu, Yanyun
    Xie, Yuan
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3667 - 3675
  • [7] Diverse-Feature Collaborative Progressive Learning for Visible-Infrared Person Re-Identification
    Chan, Sixian
    Meng, Weihao
    Bai, Cong
    Hu, Jie
    Chen, Shenyong
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (05) : 7754 - 7763
  • [8] Occluded Visible-Infrared Person Re-Identification
    Feng, Yujian
    Ji, Yimu
    Wu, Fei
    Gao, Guangwei
    Gao, Yang
    Liu, Tianliang
    Liu, Shangdong
    Jing, Xiao-Yuan
    Luo, Jiebo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1401 - 1413
  • [9] Unsupervised Visible-Infrared Person Re-Identification via Progressive Graph Matching and Alternate Learning
    Wu, Zesen
    Ye, Mang
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9548 - 9558
  • [10] Progressive Cross-Modal Association Learning for Unsupervised Visible-Infrared Person Re-Identification
    Yang, Yiming
    Hu, Weipeng
    Hu, Haifeng
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2025, 20 : 1290 - 1304