A multi-branch attention and alignment network for person re-identification

被引:1
作者
Lyu, Chunyan [1 ]
Ning, Wu [1 ]
Wang, Chenhui [2 ]
Wang, Kejun [1 ]
机构
[1] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
[2] Univ Calif Los Angeles, Dept Stat, Los Angeles, CA 90095 USA
基金
中国国家自然科学基金;
关键词
Person re-identification; Multi-branch deep network; Keypoints; Feature fusion; ATTRIBUTE;
D O I
10.1007/s10489-021-02885-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification plays a critical role in video surveillance and has a variety of applications. However, the body misalignment caused by detectors or pose changes sometimes makes it challenging to match features extracted from different images. To address the issues above, we propose a multi-branch attention and alignment network (MAAN). This approach is based on a deep network with three main branches. One branch is used for global feature representations. Another branch implements a multi-attention process based on keypoints, filters the practical information in the image, and then horizontally partitions the image to extract local features. For the last branch, we create a method based on part feature alignment. We obtain 17 keypoints from a pretrained pose estimation model, and nine local regions from the corresponding feature map are extracted for alignment. Experimental results on various popular datasets demonstrate that our method can produce competitive results under posture changes and body misalignment.
引用
收藏
页码:10845 / 10866
页数:22
相关论文
共 83 条
[1]  
Ahmed E, 2015, PROC CVPR IEEE, P3908, DOI 10.1109/CVPR.2015.7299016
[2]  
[Anonymous], 2017, In defense of the triplet loss for person re-identification
[3]   Deep-Person: Learning discriminative deep features for person Re-Identification [J].
Bai, Xiang ;
Yang, Mingkun ;
Huang, Tengteng ;
Dou, Zhiyong ;
Yu, Rui ;
Xu, Yongchao .
PATTERN RECOGNITION, 2020, 98
[4]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[5]   Multi-Level Factorisation Net for Person Re-Identification [J].
Chang, Xiaobin ;
Hospedales, Timothy M. ;
Xiang, Tao .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2109-2118
[6]   ABD-Net: Attentive but Diverse Person Re-Identification [J].
Chen, Tianlong ;
Ding, Shaojin ;
Xie, Jingyi ;
Yuan, Ye ;
Chen, Wuyang ;
Yang, Yang ;
Ren, Zhou ;
Wang, Zhangyang .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8350-8360
[7]   Person Re-Identification by Deep Learning Multi-Scale Representations [J].
Chen, Yanbei ;
Zhu, Xiatian ;
Gong, Shaogang .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :2590-2600
[8]  
Cheng DS, 2014, ADV COMPUT VIS PATT, P139, DOI 10.1007/978-1-4471-6296-4_7
[9]   Custom Pictorial Structures for Re-identification [J].
Cheng, Dong Seon ;
Cristani, Marco ;
Stoppa, Michele ;
Bazzani, Loris ;
Murino, Vittorio .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2011, 2011,
[10]   Batch DropBlock Network for Person Re-identification and Beyond [J].
Dai, Zuozhuo ;
Chen, Mingqiang ;
Gu, Xiaodong ;
Zhu, Siyu ;
Tan, Ping .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3690-3700