Cross domain knowledge learning with dual-branch adversarial network for vehicle re-identification

被引:25
作者
Peng, Jinjia [1 ]
Wang, Huibing [1 ]
Xu, Fengqiang [1 ]
Fu, Xianping [1 ,2 ]
机构
[1] Dalian Maritime Univ, Coll Informat & Sci Technol, Dalian 116021, Liaoning, Peoples R China
[2] Pengcheng Lab, Shenzhen 518055, Guangdong, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Domain adaptation; Dual-branch adversarial network; Vehicle re-identification; PERSON REIDENTIFICATION; ADAPTATION;
D O I
10.1016/j.neucom.2020.02.112
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The widespread popularization of vehicles has facilitated all people's life during the last decades. However, the emergence of a large number of vehicles poses the critical but challenging problem of vehicle re-identification (reID). Till now, for most vehicle reID algorithms, both the training and testing processes are conducted on the same annotated datasets under supervision. However, even a well-trained model will still cause fateful performance drop due to the severe domain bias between the trained dataset and the real-world scenes. To address this problem, this paper proposes a domain adaptation framework for vehicle reID (DAVR), which narrows the cross-domain bias by fully exploiting the labeled data from the source domain to adapt the target domain. DAVR develops an image-to-image translation network named Dual-branch Adversarial Network (DAN), which promotes the images from the source domain (well-labeled) to learn the style of the target domain (unlabeled). Specially, DAN doesn't need any annotation and can preserve identity information from source domain before and after translation. Furthermore, the generated images are employed to train the vehicle reID model by a proposed attention-based feature learning network. Through the proposed framework, the well-trained reID model has better generalization ability for various scenes in real-world situations. Comprehensive experimental results have demonstrated that our proposed DAVR can achieve excellent performances on benchmark datasets VehiclelD and VeRi-776. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:133 / 144
页数:12
相关论文
共 50 条
[1]  
Abadi M, 2016, ACM SIGPLAN NOTICES, V51, P1, DOI [10.1145/2951913.2976746, 10.1145/3022670.2976746]
[2]   Person Re-identification by Multi-hypergraph Fusion [J].
An, Le ;
Chen, Xiaojing ;
Yang, Songfan ;
Li, Xuelong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (11) :2763-2774
[3]  
[Anonymous], 2017, ARXIV170307220
[4]  
[Anonymous], 2016, ARXIV161102200
[5]   Group-Sensitive Triplet Embedding for Vehicle Reidentification [J].
Bai, Yan ;
Lou, Yihang ;
Gao, Feng ;
Wang, Shiqi ;
Wu, Yuwei ;
Duan, Ling-Yu .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (09) :2385-2399
[6]   Multi-Task Vehicle Detection With Region-of-Interest Voting [J].
Chu, Wenqing ;
Liu, Yao ;
Shen, Chen ;
Cai, Deng ;
Hua, Xian-Sheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :432-441
[7]   Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification [J].
Deng, Weijian ;
Zheng, Liang ;
Ye, Qixiang ;
Kang, Guoliang ;
Yang, Yi ;
Jiao, Jianbin .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :994-1003
[8]   AI-Oriented Large-Scale Video Management for Smart City: Technologies, Standards, and Beyond [J].
Duan, Lingyu ;
Lou, Yihang ;
Wang, Shiqi ;
Gao, Wen ;
Rui, Yong .
IEEE MULTIMEDIA, 2019, 26 (02) :8-20
[9]  
Fang X., 2018, ARXIV181211478
[10]   Image Style Transfer Using Convolutional Neural Networks [J].
Gatys, Leon A. ;
Ecker, Alexander S. ;
Bethge, Matthias .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2414-2423