Dynamically Transformed Instance Normalization Network for Generalizable Person Re-Identification

被引:42
作者
Jiao, Bingliang [1 ,2 ,3 ,5 ]
Liu, Lingqiao [4 ]
Gao, Liying [1 ,2 ,3 ]
Lin, Guosheng [5 ]
Yang, Lu [1 ,2 ,3 ]
Zhang, Shizhou [1 ,3 ]
Wang, Peng [1 ,2 ,3 ]
Zhang, Yanning [1 ,3 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian, Peoples R China
[2] Northwestern Polytech Univ, Ningbo Inst, Xian, Peoples R China
[3] Natl Engn Lab Integrated Aerosp Ground Ocean, Xian, Peoples R China
[4] Univ Adelaide, Adelaide, SA, Australia
[5] Nanyang Technol Univ, Singapore, Singapore
来源
COMPUTER VISION - ECCV 2022, PT XIV | 2022年 / 13674卷
基金
中国国家自然科学基金; 国家重点研发计划; 新加坡国家研究基金会;
关键词
Person re-identification; Domain generalization; Instance Normalization; Dynamic convolution;
D O I
10.1007/978-3-031-19781-9_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Existing person re-identification methods often suffer significant performance degradation on unseen domains, which fuels interest in domain generalizable person re-identification (DG-PReID). As an effective technology to alleviate domain variance, the Instance Normalization (IN) has been widely employed in many existing works. However, IN also suffers from the limitation of eliminating discriminative patterns that might be useful for a particular domain or instance. In this work, we propose a new normalization scheme called Dynamically Transformed Instance Normalization (DTIN) to alleviate the drawback of IN. Our idea is to employ dynamic convolution to allow the unnormalized feature to control the transformation of the normalized features into new representations. In this way, we can ensure the network has sufficient flexibility to strike the right balance between eliminating irrelevant domain-specific features and adapting to individual domains or instances. We further utilize a multi-task learning strategy to train the model, ensuring it can adaptively produce discriminative feature representations for an arbitrary domain. Our results show a great domain generalization capability and achieve state-of-the-art performance on three mainstream DG-PReID settings.
引用
收藏
页码:285 / 301
页数:17
相关论文
共 34 条
[1]   Person30K: A Dual-Meta Generalization Network for Person Re-Identification [J].
Bai, Yan ;
Jiao, Jile ;
Ce, Wang ;
Liu, Jun ;
Lou, Yihang ;
Feng, Xuetao ;
Duan, Ling-Yu .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2123-2132
[2]   SCA-CNN: Spatial and Channel-wise Attention in Convolutional Networks for Image Captioning [J].
Chen, Long ;
Zhang, Hanwang ;
Xiao, Jun ;
Nie, Liqiang ;
Shao, Jian ;
Liu, Wei ;
Chua, Tat-Seng .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6298-6306
[3]   Meta Batch-Instance Normalization for Generalizable Person Re-Identification [J].
Choi, Seokeon ;
Kim, Taekyung ;
Jeong, Minki ;
Park, Hyoungseob ;
Kim, Changick .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :3424-3434
[4]   Generalizable Person Re-identification with Relevance-aware Mixture of Experts [J].
Dai, Yongxing ;
Li, Xiaotong ;
Liu, Jun ;
Tong, Zekun ;
Duan, Ling-Yu .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :16140-16149
[5]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[6]   Viewpoint Invariant Pedestrian Recognition with an Ensemble of Localized Features [J].
Gray, Douglas ;
Tao, Hai .
COMPUTER VISION - ECCV 2008, PT I, PROCEEDINGS, 2008, 5302 :262-275
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]  
Hirzer M, 2011, LECT NOTES COMPUT SC, V6688, P91, DOI 10.1007/978-3-642-21227-7_9
[9]  
Jia JR, 2019, Arxiv, DOI arXiv:1905.03422
[10]  
Jia X., 2016, Advances in Neural Information Processing Systems, P667