Enhancing the discriminative feature learning for visible-thermal cross-modality person re-identification

被引:83
作者
Liu, Haijun [1 ]
Cheng, Jian [1 ]
Wang, Wen [1 ]
Su, Yanzhou [1 ]
Bai, Haiwei [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
基金
中国国家自然科学基金;
关键词
Person re-identification; Visible-thermal; Cross-modality discrepancy; Enhancing the discriminative feature learning; RANKING;
D O I
10.1016/j.neucom.2020.01.089
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing person re-identification has achieved great progress in the visible domain, capturing all the person images with visible cameras. However, in a 24-hour intelligent surveillance system, the visible cameras may be noneffective at night. In this situation, thermal cameras are the best supplemental components, which capture images without depending on visible light. Therefore, in this paper, we investigate the visible-thermal cross-modality person re-identification (VT Re-ID) problem. In VT Re-ID, there are two knotty problems should be well handled, cross-modality discrepancy and intra-modality variations. To address these two issues, we propose focusing on enhancing the discriminative feature learning (EDFL) with two extremely simple means from two core aspects, (1) skip-connection for mid-level features incorporation to improve the person features with more discriminability and robustness, and (2) dual-modality triplet loss to guide the training procedures by simultaneously considering the cross-modality discrepancy and intra-modality variations. Additionally, the two-stream CNN structure is adopted to learn the multi-modality sharable person features. The experimental results on two datasets show that our proposed EDFL approach distinctly outperforms state-of-the-art methods by large margins, demonstrating the effectiveness of our EDFL to enhance the discriminative feature learning for VT Re-ID. (C) 2020 Published by Elsevier B.V.
引用
收藏
页码:11 / 19
页数:9
相关论文
共 37 条
[1]  
[Anonymous], 2016, ARXIV
[2]  
[Anonymous], IEEE TCSVT
[3]  
[Anonymous], IEEE TII
[4]  
[Anonymous], ECCV
[5]  
Cao Y, 2017, AAAI CONF ARTIF INTE, P3974
[6]   Multi-Level Factorisation Net for Person Re-Identification [J].
Chang, Xiaobin ;
Hospedales, Timothy M. ;
Xiang, Tao .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2109-2118
[7]   Person Re-Identification by Camera Correlation Aware Feature Augmentation [J].
Chen, Ying-Cong ;
Zhu, Xiatian ;
Zheng, Wei-Shi ;
Lai, Jian-Huang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (02) :392-408
[8]  
Dai PY, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P677
[9]   Mutual Component Convolutional Neural Networks for Heterogeneous Face Recognition [J].
Deng, Zhongying ;
Peng, Xiaojiang ;
Li, Zhifeng ;
Qiao, Yu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (06) :3102-3114
[10]  
Hao Y, 2019, AAAI CONF ARTIF INTE, P8385