Bidirectional modality information interaction for Visible-Infrared Person Re-identification

被引:0
|
作者
Yang, Xi [1 ]
Liu, Huanling [2 ]
Wang, Nannan [1 ]
Gao, Xinbo [3 ,4 ]
机构
[1] Xidian Univ, Xian 710071, Peoples R China
[2] Xidian Univ, Hangzhou Inst Technol, Hangzhou 311231, Peoples R China
[3] Xidian Univ, Sch Elect Engn, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[4] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Image Cognit, Chongqing 400065, Peoples R China
基金
中国国家自然科学基金;
关键词
Dynamic aggregation; Feature intersection; Multi-weight loss;
D O I
10.1016/j.patcog.2024.111301
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the distinct imaging principles of visible and infrared images, significant challenges arise for visible- infrared person re-identification (VI-ReID). Current methods either establish intermediate modalities to reduce image differences or use various techniques to extract better shared features. However, despite the modality differences in VI-ReID, significant similarities in contours and postures exist, so focusing on learning feature representation can fundamentally solve the problem. To this end, this paper proposes a bidirectional modality information interaction network to reduce the difficulty of inter-modality recognition and enhance intramodality feature extraction. To fully exploit cross-modality information, the Dynamic Aggregation (DA) module iteratively projects features of both modalities onto each other, embedding image attributes from both, enabling mutual learning, improving feature representation, and reducing modality differences. To enhance intramodality feature representation, the Feature Intersection (FI) module combines two pooling styles in a novel way, ensuring global connection of local features and regional highlights. Lastly, we propose a Multi-Weight (MW) loss to increase the center distance of same identity features within the same modality, helping the model better learn identity attributes. Extensive experiments on SYSU-MM01 and RegDB confirm the superiority of our approach.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Modality Unifying Network for Visible-Infrared Person Re-Identification
    Yu, Hao
    Cheng, Xu
    Peng, Wei
    Liu, Weihao
    Zhao, Guoying
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 11151 - 11161
  • [2] Interaction and Alignment for Visible-Infrared Person Re-Identification
    Gong, Jiahao
    Zhao, Sanyuan
    Lam, Kin-Man
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2253 - 2259
  • [3] Visible-Infrared Person Re-Identification via Cross-Modality Interaction Transformer
    Feng, Yujian
    Yu, Jian
    Chen, Feng
    Ji, Yimu
    Wu, Fei
    Liu, Shangdon
    Jing, Xiao-Yuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7647 - 7659
  • [4] Hybrid Modality Metric Learning for Visible-Infrared Person Re-Identification
    Zhang, La
    Guo, Haiyun
    Zhu, Kuan
    Qiao, Honglin
    Huang, Gaopan
    Zhang, Sen
    Zhang, Huichen
    Sun, Jian
    Wang, Jinqiao
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2022, 18 (01)
  • [5] An efficient framework for visible-infrared cross modality person re-identification
    Basaran, Emrah
    Gokmen, Muhittin
    Kamasak, Mustafa E.
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2020, 87
  • [6] Cross-Modality Transformer for Visible-Infrared Person Re-Identification
    Jiang, Kongzhu
    Zhang, Tianzhu
    Liu, Xiang
    Qian, Bingqiao
    Zhang, Yongdong
    Wu, Feng
    COMPUTER VISION - ECCV 2022, PT XIV, 2022, 13674 : 480 - 496
  • [7] Cross-Modality Transformer With Modality Mining for Visible-Infrared Person Re-Identification
    Liang, Tengfei
    Jin, Yi
    Liu, Wu
    Li, Yidong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8432 - 8444
  • [8] Occluded Visible-Infrared Person Re-Identification
    Feng, Yujian
    Ji, Yimu
    Wu, Fei
    Gao, Guangwei
    Gao, Yang
    Liu, Tianliang
    Liu, Shangdong
    Jing, Xiao-Yuan
    Luo, Jiebo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1401 - 1413
  • [9] Tri-Level Modality-Information Disentanglement for Visible-Infrared Person Re-Identification
    Lu, Zefeng
    Lin, Ronghao
    Hu, Haifeng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2700 - 2714
  • [10] Visible-Infrared Person Re-Identification With Modality-Specific Memory Network
    Li, Yulin
    Zhang, Tianzhu
    Liu, Xiang
    Tian, Qi
    Zhang, Yongdong
    Wu, Feng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 7165 - 7178