Deep Attention Network for RGB-Infrared Cross-Modality Person Re-Identification

被引:8
作者
Li, Yang [1 ,2 ]
Xu, Huahu [2 ]
机构
[1] Shanghai Jianqiao Univ, Sch Informat Technol, Shanghai 201306, Peoples R China
[2] Shanghai Univ, Sch Comp Engn & Sci, Shanghai 200444, Peoples R China
来源
4TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE APPLICATIONS AND TECHNOLOGIES (AIAAT 2020) | 2020年 / 1642卷
关键词
D O I
10.1088/1742-6596/1642/1/012015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGB-Infrared cross-modality person re-identification is an important task for 24-hour full-time intelligent video surveillance, the task is challenging because of cross modal heterogeneity and intra modal variation. A novel deep attention network is proposed in this paper to handle these challenges by increasing the discriminability of the learned person features. The method includes three elements: (1) dual-path CNN to extract the feature maps of the RGB images and infrared images respectively, (2) dual-attention mechanism combining spatial attention and channel attention to enhance the discriminability of extracted features, and (3) joint loss function joining bi-directional ranking loss and identity loss to constraint the training process to further increase the accuracy. Extensive experiments on two public datasets demonstrate the effectiveness of our proposed method because the method achieves higher performance than state-of-the-arts methods.
引用
收藏
页数:7
相关论文
共 14 条
[1]  
[Anonymous], 2018, 32 AAAI C ART INT
[2]  
Dai PY, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P677
[3]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[4]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]
[5]   End to End Person Re-Identification Based on Attention Mechanism [J].
Li, Yang ;
Xu, Huahu ;
Bian, Minjie .
2019 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE APPLICATIONS AND TECHNOLOGIES (AIAAT 2019), 2019, 646
[6]   Person Recognition System Based on a Combination of Body Images from Visible Light and Thermal Cameras [J].
Nguyen, Dat Tien ;
Hong, Hyung Gil ;
Kim, Ki Wan ;
Park, Kang Ryoung .
SENSORS, 2017, 17 (03)
[7]   Beyond Part Models: Person Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline) [J].
Sun, Yifan ;
Zheng, Liang ;
Yang, Yi ;
Tian, Qi ;
Wang, Shengjin .
COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 :501-518
[8]   Mancs: A Multi-task Attentional Network with Curriculum Sampling for Person Re-Identification [J].
Wang, Cheng ;
Zhang, Qian ;
Huang, Chang ;
Liu, Wenyu ;
Wang, Xinggang .
COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 :384-400
[9]   Non-local Neural Networks [J].
Wang, Xiaolong ;
Girshick, Ross ;
Gupta, Abhinav ;
He, Kaiming .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7794-7803
[10]   Learning to Reduce Dual-level Discrepancy for Infrared-Visible Person Re-identification [J].
Wang, Zhixiang ;
Wang, Zheng ;
Zheng, Yinqiang ;
Chuang, Yung-Yu ;
Satoh, Shin'ichi .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :618-626