Dual-alignment Feature Embedding for Cross-modality Person Re-identification

被引:69
作者
Hao, Yi [1 ]
Wang, Nannan [1 ]
Gao, Xinbo [1 ]
Li, Jie [1 ]
Wang, Xiaoyu [2 ]
机构
[1] Xidian Univ, Sch Elect Engn, ISN State Key Lab, Xian, Peoples R China
[2] Intellifusion, Shenzhen, Peoples R China
来源
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19) | 2019年
基金
中国国家自然科学基金;
关键词
cross-modality; person re-identification; distribution; fine-grained;
D O I
10.1145/3343031.3351006
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Person re-identification aims at searching pedestrians across different cameras, which is a key problem in video surveillance. With requirements in night environment, RGB-infrared person re-identification which could be regarded as a cross-modality matching problem, has gained increasing attention in recent years. Aside from cross-modality discrepancy, RGB-infrared person re-identification also suffers from human pose and view point differences. We design a dual-alignment feature embedding method to extract discriminative modality-invariant features. The concept of dual-alignment is two folds: spatial and modality alignments. We adopt the part-level features to extract fine-grained camera-invariant information. We introduce distribution loss function and correlation loss function to align the embedding features across visible and infrared modalities. Finally, we can extract modality-invariant features with robust and rich identity embeddings for cross-modality person re-identification. Experiment confirms that the proposed baseline and improvement achieves competitive results with the state-of-the-art methods on two datasets. For instance, We achieve (57.5+12.6)% rank-1 accuracy and (57.3+11.8)% mAP on the RegDB dataset.
引用
收藏
页码:57 / 65
页数:9
相关论文
共 35 条
[1]  
[Anonymous], 2018, LEARNING DISCRIMINAT
[2]  
[Anonymous], 2018, EUR C COMP VIS ECCV
[3]  
[Anonymous], LOCAL CONVOLUTIONAL
[4]  
[Anonymous], P EUR C COMP VIS ECC
[5]  
[Anonymous], ACM T MULTIMEDIA COM
[6]  
[Anonymous], 2018, 32 AAAI C ART INT
[7]  
[Anonymous], 2018 ACM MULT C MULT
[8]   Person Re-Identification by Camera Correlation Aware Feature Augmentation [J].
Chen, Ying-Cong ;
Zhu, Xiatian ;
Zheng, Wei-Shi ;
Lai, Jian-Huang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (02) :392-408
[9]  
Dai PY, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P677
[10]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672, DOI DOI 10.1145/3422622