Dual-Path Part-Level Method for Visible-Infrared Person Re-identification

被引:9
作者
Xiang, Xuezhi [1 ]
Lv, Ning [1 ]
Zhai, Mingliang [1 ]
Abdeen, Rokia [1 ]
El Saddik, Abdulmotaleb [2 ]
机构
[1] Harbin Engn Univ, Sch Informat & Commun Engn, Harbin 150001, Peoples R China
[2] Univ Ottawa, Sch Elect Engn & Comp Sci, Ottawa, ON K1N 6N5, Canada
基金
中国国家自然科学基金; 黑龙江省自然科学基金;
关键词
Cross-modality person re-identification; Visible-infrared; Human part-level; Loss function;
D O I
10.1007/s11063-020-10239-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visible-infrared cross-modality person re-identification is a realistic problem of person re-identification. Under poor illumination scenario, general methods of visible-visible person re-identification can not solve the problem well. If we directly compare the visible images of pedestrians captured under dark lighting with the visible images of pedestrians captured under normal light, this extreme color deviation will greatly reduce the recognition ability of the learned representations. In this paper, we propose a dual-path framework for visible-infrared cross-modality person re-identification based human part level features. Feature learning module contains modality-specific dual-path layers and modality-shared human part-level layers, which achieve discriminative global and local representations. In order to better optimize the proposed network, we design a global loss function and a local loss function for the global features and local features, respectively. The two loss functions are integrated together to train the network. We verify the effectiveness of our method on the challenging benchmarks: SYSU-MM01 and RegDB. Experimental results show that, compared with other cross-modality methods, our method has better effect in improving visible-infrared cross-modality person re-identification tasks.
引用
收藏
页码:313 / 328
页数:16
相关论文
共 33 条
[1]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[2]  
Dai PY, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P677
[3]  
Dai Zuozhuo, 2018, ARXIV PREPRINT ARXIV
[4]  
Deng Jiankang, 2019, Computer Vision and Pattern Recognition
[5]   Learning Modality-Specific Representations for Visible-Infrared Person Re-Identification [J].
Feng, Zhanxiang ;
Lai, Jianhuang ;
Xie, Xiaohua .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :579-590
[6]   Efficient and Deep Person Re-Identification using Multi-Level Similarity [J].
Guo, Yiluan ;
Cheung, Ngai-Man .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2335-2344
[7]  
Hao Y, 2019, AAAI CONF ARTIF INTE, P8385
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]  
Hermans A, 2017, ARXIV
[10]  
Hu X, 2018, IEEE IMAGE PROC, P848, DOI 10.1109/ICIP.2018.8451645