Partner learning: A comprehensive knowledge transfer for vehicle re-identification

被引:7
作者
Qian, Wen [1 ,2 ]
He, Zhiqun [3 ]
Chen, Chen [1 ]
Peng, Silong [2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Beijing, Peoples R China
[3] SenseTime Grp Ltd, Beijing, Peoples R China
关键词
Vehicle Re-ID; Partner learning; Knowledge transfer; Neural network;
D O I
10.1016/j.neucom.2022.01.043
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The intra-class variability and inter-class similarity challenges caused by diverse viewpoints, illumination, and similar appearances are crucial in Re-Identification (Re-ID). Previous vehicle Re-ID methods propose to mine more discriminate and fine-grained clues for alleviating the problem, which costs extra computation and time during inference since the use of additional modules, e.g., detection modules, segmentation modules, or attention modules. We propose a multi-branch architecture to mining the discriminative and fine-grained information without additional time and computation cost during inference. Specifically, we focus on three problems: 1) how can knowledge transfer among multi branches; 2) what knowledge should be utilized for more effective and more functional transfer; 3) where can be used as the input of multi-branches? For the first problem, we introduce a novel complementary learning scheme named partner learning which transfers the knowledge between global and local branches, and thus we only need the global branch during inference. For the second problem, we propose a hierarchical structural knowledge transfer (HSKT) approach to mine knowledge from partners in three different levels hierarchically. For the last problem, to effectively mine more fine-grained clues, we propose two local specifications: one supervised with the specification of the window area being discriminatively crucial as an expert knowledge while the other unsupervised with horizontal stripe cuts. Extensive ablation studies and experimental result discussions show the effectiveness of the proposed method. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:89 / 98
页数:10
相关论文
共 54 条
[1]  
[Anonymous], 2016, PROC COMPUTER VISION
[2]  
Arsigny V, 2005, LECT NOTES COMPUT SC, V3749, P115
[3]   Group-Sensitive Triplet Embedding for Vehicle Reidentification [J].
Bai, Yan ;
Lou, Yihang ;
Gao, Feng ;
Wang, Shiqi ;
Wu, Yuwei ;
Duan, Ling-Yu .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (09) :2385-2399
[4]  
Chen H., 2019, P IEEE CVF C COMP VI, P184, DOI DOI 10.1109/ICIP46576.2022.9897541
[5]  
Chen T., 2016, INT C LEARN REPR
[6]   Orientation-Aware Vehicle Re-Identification with Semantics-Guided Part Attention Network [J].
Chen, Tsai-Shien ;
Liu, Chih-Ting ;
Wu, Chih-Wei ;
Chien, Shao-Yi .
COMPUTER VISION - ECCV 2020, PT II, 2020, 12347 :330-346
[7]  
Chen Yucheng, 2019, CVPR WORKSH, V2
[8]   Vehicle Re-identification with Viewpoint-aware Metric Learning [J].
Chu, Ruihang ;
Sun, Yifan ;
Li, Yadong ;
Liu, Zheng ;
Zhang, Chi ;
Wei, Yichen .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8281-8290
[9]   Multi-Task Vehicle Detection With Region-of-Interest Voting [J].
Chu, Wenqing ;
Liu, Yao ;
Shen, Chen ;
Cai, Deng ;
Hua, Xian-Sheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :432-441
[10]   Efficient Knowledge Distillation from an Ensemble of Teachers [J].
Fukuda, Takashi ;
Suzuki, Masayuki ;
Kurata, Gakuto ;
Thomas, Samuel ;
Cui, Jia ;
Ramabhadran, Bhuvana .
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, :3697-3701