Harmonious Multi-branch Network for Person Re-identification with Harder Triplet Loss

被引:15
作者
Tang, Zengming [1 ,2 ]
Huang, Jun [1 ,2 ]
机构
[1] Chinese Acad Sci, Shanghai Adv Res Inst, 99 Haike Rd, Shanghai 201210, Peoples R China
[2] Univ Chinese Acad Sci, 19A Yuquan Rd, Beijing 100049, Peoples R China
基金
国家重点研发计划;
关键词
Person re-identification; pooling strategy; attention mechanism; triplet loss; NEURAL-NETWORK; ATTENTION;
D O I
10.1145/3501405
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, advances in person re-identification (Re-ID) has benefitted from use of the popular multi-branch network. However, performing feature learning in a single branch with uniform partitioning is likely to separate meaningful local regions, and correlation among different branches is not well established. In this article, we propose a novel harmonious multi-branch network (HMBN) to relieve these intra-branch and inter-branch problems harmoniously. HMBN is a multi-branch network with various stripes on different branches to learn coarse-to-fine pedestrian information. We first replace the uniform partition with a horizontal overlapped partition to cover meaningful local regions between adjacent stripes in a single branch. We then incorporate a novel attention module to make all branches interact by modeling spatial contextual dependencies across branches. Finally, in order to train the HMBN more effectively, a harder triplet loss is introduced to optimize triplets in a harder manner. Extensive experiments are conducted on three benchmark datasets - DukeMTMC-reID, CUHK03, and Market-1501 - demonstrating the superiority of our proposed HMBN over state-of-the-art methods.
引用
收藏
页数:21
相关论文
共 70 条
[1]   Partially Shared Multi-Task Convolutional Neural Network with Local Constraint for Face Attribute Learning [J].
Cao, Jiajiong ;
Li, Yingming ;
Zhang, Zhongfei .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4290-4299
[2]   Multi-Level Factorisation Net for Person Re-Identification [J].
Chang, Xiaobin ;
Hospedales, Timothy M. ;
Xiang, Tao .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2109-2118
[3]   Spatial-Temporal Attention-Aware Learning for Video-Based Person Re-Identification [J].
Chen, Guangyi ;
Lu, Jiwen ;
Yang, Ming ;
Zhou, Jie .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (09) :4192-4205
[4]   Graph-Based Global Reasoning Networks [J].
Chen, Yunpeng ;
Rohrbach, Marcus ;
Yan, Zhicheng ;
Yan, Shuicheng ;
Feng, Jiashi ;
Kalantidis, Yannis .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :433-442
[5]   Person Re-Identification by Multi-Channel Parts-Based CNN with Improved Triplet Loss Function [J].
Cheng, De ;
Gong, Yihong ;
Zhou, Sanping ;
Wang, Jinjun ;
Zheng, Nanning .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1335-1344
[6]   Show, Control and Tell: A Framework for Generating Controllable and Grounded Captions [J].
Cornia, Marcella ;
Baraldi, Lorenzo ;
Cucchiara, Rita .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :8299-8308
[7]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[8]  
Felzenszwalb P, 2008, PROC CVPR IEEE, P1984
[9]  
Fu Y, 2019, AAAI CONF ARTIF INTE, P8295
[10]   Foreground Gating and Background Refining Network for Surveillance Object Detection [J].
Fu, Zhihang ;
Chen, Yaowu ;
Yong, Hongwei ;
Jiang, Rongxin ;
Zhang, Lei ;
Hua, Xian-Sheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (12) :6077-6090