TBE-Net: A Three-Branch Embedding Network With Part-Aware Ability and Feature Complementary Learning for Vehicle Re-Identification

被引:110
作者
Sun, Wei [1 ,2 ]
Dai, Guangzhao [1 ]
Zhang, Xiaorui [3 ,4 ,5 ]
He, Xiaozheng [6 ]
Chen, Xuan [7 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Automat, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Nanjing 210044, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Minist Educ, Sch Comp & Software, Nanjing 210044, Peoples R China
[4] Nanjing Univ Informat Sci & Technol, Minist Educ, Engn Res Ctr Digital Forens, Nanjing 210044, Peoples R China
[5] Nanjing Univ Informat Sci & Technol, Wuxi Res Inst, Wuxi 214100, Jiangsu, Peoples R China
[6] Rensselaer Polytech Inst, Dept Civil & Environm Engn, Troy, NY 12180 USA
[7] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Cameras; Image color analysis; Information science; Sun; Training; Technological innovation; Vehicle re-identification; attention mechanism; multi-granularity features learning; embedding;
D O I
10.1109/TITS.2021.3130403
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Vehicle re-identification (Re-ID) is one of the promising applications in the field of computer vision. Existing vehicle Re-ID methods mainly focus on global appearance features or pre-defined local region features, which have difficulties in handling inter-class similarities and intra-class differences among vehicles in various traffic scenarios. This paper proposes a novel end-to-end three-branch embedding network (TBE-Net) with feature complementary learning and part-aware ability. The proposed TBE-Net integrates complementary features, global appearance, and local region features into a unified framework for subtle feature learning, thereby obtaining more integral and diverse vehicle features to re-identify the vehicle from similar ones. The local region feature branch in the proposed TBE-Net contains an attention module that highlights the major differences among local regions by adaptively assigning large weights to the critical local regions and small weights to insignificant local regions, thereby enhancing the perception sensitivity of the network to subtle discrepancies. The complementary branch in the proposed TBE-Net exploits different pooling operations to obtain more comprehensive structural features and multi-granularity features as a supplement to the global appearance and local region features. The abundant features help accommodate the ever-changing critical local regions in vehicles' images due to the sensors' settings, such as the position and shooting angle of surveillance cameras. The extensive experiments on VehicleID and VeRi-776 datasets show that the proposed TBE-Net outperforms the state-of-the-art methods.
引用
收藏
页码:14557 / 14569
页数:13
相关论文
共 53 条
[1]  
[Anonymous], 2016, P ADV NEUR INF PROC
[2]  
Bai Y, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P474
[3]   Group-Sensitive Triplet Embedding for Vehicle Reidentification [J].
Bai, Yan ;
Lou, Yihang ;
Gao, Feng ;
Wang, Shiqi ;
Wu, Yuwei ;
Duan, Ling-Yu .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (09) :2385-2399
[4]   CP-mtML: Coupled Projection multi-task Metric Learning for Large Scale Face Retrieval [J].
Bhattarai, Binod ;
Sharma, Gaurav ;
Jurie, Frederic .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :4226-4235
[5]   Orientation-Aware Vehicle Re-Identification with Semantics-Guided Part Attention Network [J].
Chen, Tsai-Shien ;
Liu, Chih-Ting ;
Wu, Chih-Wei ;
Chien, Shao-Yi .
COMPUTER VISION - ECCV 2020, PT II, 2020, 12347 :330-346
[6]   Person Re-Identification by Multi-Channel Parts-Based CNN with Improved Triplet Loss Function [J].
Cheng, De ;
Gong, Yihong ;
Zhou, Sanping ;
Wang, Jinjun ;
Zheng, Nanning .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1335-1344
[7]  
Christlein Vincent, 2019, 2019 International Conference on Document Analysis and Recognition (ICDAR). Proceedings, P1090, DOI 10.1109/ICDAR.2019.00177
[8]   Vehicle Re-identification with Viewpoint-aware Metric Learning [J].
Chu, Ruihang ;
Sun, Yifan ;
Li, Yadong ;
Liu, Zheng ;
Zhang, Chi ;
Wei, Yichen .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8281-8290
[9]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[10]  
Guo HY, 2018, AAAI CONF ARTIF INTE, P6853