Multi-level feature learning with attention for person re-identification

被引:9
作者
Xiang, Suncheng [1 ]
Fu, Yuzhuo [1 ]
Chen, Hao [1 ]
Ran, Wei [1 ]
Liu, Ting [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Re-identification; Multi-branch; Semantically aligned region; Self-attention; NETWORK;
D O I
10.1007/s11042-020-09569-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Person re-identification (re-ID) aims to match a specific person in a large gallery with different cameras and locations. Previous part-based methods mainly focus on part-level features with uniform partition, which increases learning ability for discriminative feature but not efficient or robust to scenarios with large variances. To address this problem, in this paper, we propose a novel feature fusion strategy based on traditional convolutional neural network. Then, a multi-branch deeper feature fusion network architecture is designed to perform discriminative learning for three semantically aligned region. Based on it, a novel self-attention mechanism is employed to softly assign corresponding weights to the semantic aligned feature during back-propagation. Comprehensive experiments have been conducted on several large-scale benchmark datasets, which demonstrates that proposed approach yields consistent and competitive re-ID accuracy compared with current single-domain re-ID methods.
引用
收藏
页码:32079 / 32093
页数:15
相关论文
共 38 条
[1]  
[Anonymous], 2014, LECT NOTES COMPUT SC
[2]  
[Anonymous], 2017, CoRR abs/1711.08184
[3]  
[Anonymous], 2017, IEEE INT CONF COMP V, DOI DOI 10.1109/ICCVW.2017.304
[4]   Multi-Level Factorisation Net for Person Re-Identification [J].
Chang, Xiaobin ;
Hospedales, Timothy M. ;
Xiang, Tao .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2109-2118
[5]   Attention to Scale: Scale-aware Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Yang, Yi ;
Wang, Jiang ;
Xu, Wei ;
Yuille, Alan L. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3640-3649
[6]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[7]   RMPE: Regional Multi-Person Pose Estimation [J].
Fang, Hao-Shu ;
Xie, Shuqin ;
Tai, Yu-Wing ;
Lu, Cewu .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2353-2362
[8]   Self-similarity Grouping: A Simple Unsupervised Cross Domain Adaptation Approach for Person Re-identification [J].
Fu, Yang ;
Wei, Yunchao ;
Wang, Guanshuo ;
Zhou, Yuqian ;
Shi, Honghui ;
Huang, Thomas S. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6111-6120
[9]  
Gao M, 2016, IEEE IMAGE PROC, P4274, DOI 10.1109/ICIP.2016.7533166
[10]   A deep fully residual convolutional neural network for segmentation in EM images [J].
He, Juanjuan ;
Xiang, Song ;
Zhu, Ziqi .
INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2020, 18 (03)