End-to-End Domain Adaptive Attention Network for Cross-Domain Person Re-Identification

被引:17
作者
Khatun, Amena [1 ]
Denman, Simon [1 ]
Sridharan, Sridha [1 ]
Fookes, Clinton [1 ]
机构
[1] Queensland Univ Technol QUT, Signal Proc Artif Intelligence & Vis Technol SAIV, Brisbane, Qld 4000, Australia
基金
澳大利亚研究理事会;
关键词
Adaptive systems; Adaptation models; Cameras; Generative adversarial networks; Transforms; Task analysis; Lighting; Person re-identification; domain adaptation; attention; image translation; end-to-end network; SIMILARITY;
D O I
10.1109/TIFS.2021.3088012
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Person re-identification (re-ID) remains challenging in a real-world scenario, as it requires a trained network to generalise to totally unseen target data in the presence of variations across domains. Recently, generative adversarial models have been widely adopted to enhance the diversity of training data. These approaches, however, often fail to generalise to other domains, as existing generative person re-identification models have a disconnect between the generative component and the discriminative feature learning stage. To address the on-going challenges regarding model generalisation, we propose an end-to-end domain adaptive attention network to jointly translate images between domains and learn discriminative re-id features in a single framework. To address the domain gap challenge, we introduce an attention module for image translation from source to target domains without affecting the identity of a person. More specifically, attention is directed to the background instead of the entire image of the person, ensuring identifying characteristics of the subject are preserved. The proposed joint learning network results in a significant performance improvement over state-of-the-art methods on several challenging benchmark datasets.
引用
收藏
页码:3803 / 3813
页数:11
相关论文
共 66 条
[21]   A Deep Four-Stream Siamese Convolutional Neural Network with Joint Verification and Identification Loss for Person Re-detection [J].
Khatun, Amena ;
Denman, Simon ;
Sridharan, Sridha ;
Fookes, Clinton .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :1292-1301
[22]  
Köstinger M, 2012, PROC CVPR IEEE, P2288, DOI 10.1109/CVPR.2012.6247939
[23]   Learning Deep Context-aware Features over Body and Latent Parts for Person Re-identification [J].
Li, Dangwei ;
Chen, Xiaotang ;
Zhang, Zhang ;
Huang, Kaiqi .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :7398-7407
[24]   Harmonious Attention Network for Person Re-Identification [J].
Li, Wei ;
Zhu, Xiatian ;
Gong, Shaogang .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2285-2294
[25]   DeepReID: Deep Filter Pairing Neural Network for Person Re-Identification [J].
Li, Wei ;
Zhao, Rui ;
Xiao, Tong ;
Wang, Xiaogang .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :152-159
[26]   Low-Latency Video Semantic Segmentation [J].
Li, Yule ;
Shi, Jianping ;
Lin, Dahua .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :5997-6005
[27]  
Liang W., 2018, M2M GAN MANY TO MANY
[28]  
Liao SC, 2015, PROC CVPR IEEE, P2197, DOI 10.1109/CVPR.2015.7298832
[29]  
Lin J, 2017, IEEE PAC RIM CONF CO
[30]  
Lin YT, 2019, AAAI CONF ARTIF INTE, P8738