Shallow-Deep Collaborative Learning for Unsupervised Visible-Infrared Person Re-Identification

被引:8
|
作者
Yang, Bin [1 ]
Chen, Jun [1 ]
Ye, Mang [1 ]
机构
[1] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Sch Comp Sci, Hubei Luojia Lab, Wuhan, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1109/CVPR52733.2024.01596
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised visible-infrared person re-identification ( US-VI-ReID) centers on learning a cross-modality retrieval model without labels, reducing the reliance on expensive cross-modality manual annotation. Previous US-VIReID works gravitate toward learning cross-modality information with the deep features extracted from the ultimate layer. Nevertheless, interfered by the multiple discrepancies, solely relying on deep features is insufficient for accurately learning modality-invariant features, resulting in negative optimization. The shallow feature from the shallow layers contains nuanced detail information, which is critical for effective cross-modality learning but is disregarded regrettably by the existing methods. To address the above issues, we design a Shallow-Deep Collaborative Learning (SDCL) framework based on the transformer with shallow-deep contrastive learning, incorporating Collaborative Neighbor Learning (CNL) and Collaborative Ranking Association (CRA) module. Specifically, CNL unveils the intrinsic homogeneous and heterogeneous collaboration which are harnessed for neighbor alignment, enhancing the robustness in a dynamic manner. Furthermore, CRA associates the cross-modality labels with the ranking association between shallow and deep features, furnishing valuable supervision for cross-modality learning. Extensive experiments validate the superiority of our method, even outperforming certain supervised counterparts.
引用
收藏
页码:16870 / 16879
页数:10
相关论文
共 50 条
  • [21] Learning with Twin Noisy Labels for Visible-Infrared Person Re-Identification
    Yang, Mouxing
    Huang, Zhenyu
    Hu, Peng
    Li, Taihao
    Lv, Jiancheng
    Peng, Xi
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14288 - 14297
  • [22] Attributes Based Visible-Infrared Person Re-identification
    Zheng, Aihua
    Feng, Mengya
    Pan, Peng
    Jiang, Bo
    Luo, Bin
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, PRCV 2022, 2022, 13534 : 254 - 266
  • [23] Interaction and Alignment for Visible-Infrared Person Re-Identification
    Gong, Jiahao
    Zhao, Sanyuan
    Lam, Kin-Man
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2253 - 2259
  • [24] Deep learning for visible-infrared cross-modality person re-identification: A comprehensive review
    Huang, Nianchang
    Liu, Jianan
    Miao, Yunqi
    Zhang, Qiang
    Han, Jungong
    INFORMATION FUSION, 2023, 91 : 396 - 411
  • [25] Modality-Shared Prototypes for Enhanced Unsupervised Visible-Infrared Person Re-Identification
    Chen, Xiaohan
    Wang, Suqing
    Zheng, Yujin
    PATTERN RECOGNITION AND COMPUTER VISION, PT XIII, PRCV 2024, 2025, 15043 : 237 - 250
  • [26] Adaptive Middle Modality Alignment Learning for Visible-Infrared Person Re-identification
    Zhang, Yukang
    Yan, Yan
    Lu, Yang
    Wang, Hanzi
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, : 2176 - 2196
  • [27] Multi-dimensional feature learning for visible-infrared person re-identification
    Yang, Zhenzhen
    Wu, Xinyi
    Yang, Yongpeng
    BIG DATA RESEARCH, 2025, 40
  • [28] Style-Agnostic Representation Learning for Visible-Infrared Person Re-Identification
    Wu, Jianbing
    Liu, Hong
    Shi, Wei
    Liu, Mengyuan
    Li, Wenhao
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2263 - 2275
  • [29] Towards a Unified Middle Modality Learning for Visible-Infrared Person Re-Identification
    Zhang, Yukang
    Yan, Yan
    Lu, Yang
    Wang, Hanzi
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 788 - 796
  • [30] Visible-infrared person re-identification via specific and shared representations learning
    Aihua Zheng
    Juncong Liu
    Zi Wang
    Lili Huang
    Chenglong Li
    Bing Yin
    Visual Intelligence, 1 (1):