Multi-granularity cross attention network for person re-identification

被引:3
作者
Han, Chengmei [1 ,2 ]
Jiang, Bo [2 ]
Tang, Jin [2 ]
机构
[1] Hefei Normal Univ, Sch Comp Sci & Technol, Hefei, Peoples R China
[2] Anhui Univ, Sch Comp Sci & Technol, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
Person re-identification; Common challenges; Multi-granularity; Cross; Attention mechanism;
D O I
10.1007/s11042-022-13833-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Typical person re-identification (Re-ID) methods suffer from common challenges from body misalignment, occlusion issues, background perturbance, pose variations, and other aspects. In solving these problems, the combination of global features and local features makes the network pay attention to the global information and local information in the image. The attention mechanism is found to be effective, which aims to strengthen the salient information and suppress the irrelevant ones. To further enhance the contribution of global information to significant information, in this paper, we propose a multi-granularity cross attention (MGCA) network for person Re-ID. The key component of our framework is the multi-granularity cross attention module, where the attention module selectively aggregates the features of each location and extracts the weighted sum of the features of each location based on each pixel's contribution to significance. Thus, it obtains the global view of the image and the spatial correlation between any two positions. The related semantic features reinforce each other, further improving compactness and semantic consistency within the classes, gaining feature refinement and feature-pair alignment, respectively. Extensive experiments demonstrate that our method is comparable to the most advanced methods.
引用
收藏
页码:14755 / 14773
页数:19
相关论文
共 61 条
[1]   Mixed High-Order Attention Network for Person Re-Identification [J].
Chen, Binghui ;
Deng, Weihong ;
Hu, Jiani .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :371-381
[2]   ABD-Net: Attentive but Diverse Person Re-Identification [J].
Chen, Tianlong ;
Ding, Shaojin ;
Xie, Jingyi ;
Yuan, Ye ;
Chen, Wuyang ;
Yang, Yang ;
Ren, Zhou ;
Wang, Zhangyang .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8350-8360
[3]   Self-attention mechanism in person re-identification models [J].
Chen, Wenbai ;
Lu, Yue ;
Ma, Hang ;
Chen, Qili ;
Wu, Xibao ;
Wu, Peiliang .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) :4649-4667
[4]   Salience-Guided Cascaded Suppression Network for Person Re-identification [J].
Chen, Xuesong ;
Fu, Canmiao ;
Zhao, Yong ;
Zheng, Feng ;
Song, Jingkuan ;
Ji, Rongrong ;
Yang, Yi .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3297-3307
[5]   Person Re-Identification by Multi-Channel Parts-Based CNN with Improved Triplet Loss Function [J].
Cheng, De ;
Gong, Yihong ;
Zhou, Sanping ;
Wang, Jinjun ;
Zheng, Nanning .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1335-1344
[6]  
Cordonnier J.-B., 2019, ARXIV
[7]   Batch DropBlock Network for Person Re-identification and Beyond [J].
Dai, Zuozhuo ;
Chen, Mingqiang ;
Gu, Xiaodong ;
Zhu, Siyu ;
Tan, Ping .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3690-3700
[8]  
Das A, 2014, LECT NOTES COMPUT SC, V8690, P330, DOI 10.1007/978-3-319-10605-2_22
[9]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[10]   Group signature with restrictive linkability: minimizing privacy exposure in ubiquitous environment [J].
Eom S. ;
Huh J.-H. .
Journal of Ambient Intelligence and Humanized Computing, 2024, 15 (02) :1411-1421