DaliID: Distortion-Adaptive Learned Invariance for Identification-A Robust Technique for Face Recognition and Person Re-Identification

被引:1
作者
Robbins, Wes [1 ,2 ]
Bertocco, Gabriel [2 ,3 ]
Boult, Terrance E. [2 ]
机构
[1] Univ Texas Austin, Dept ECE, Austin, TX 78712 USA
[2] Univ Colorado Colorado Springs, Dept Comp Sci, Colorado Springs, CO 80918 USA
[3] Univ Estadual Campinas, Inst Comp, Lab Artificial Intelligence, BR-13083970 Campinas, Brazil
关键词
Distortion; Face recognition; Training; Atmospheric modeling; Adaptation models; Benchmark testing; Robustness; Biometrics; face recognition; computer vision; person re-ID; deep learning;
D O I
10.1109/ACCESS.2024.3385782
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In real-world applications, face recognition, and person re-identification are subject to image degradations such as motion blur, atmospheric turbulence, or upsampling artifacts-which are known to lower performance. This work directly addresses challenges in low-quality scenarios with 1) practical, novel updates to training and inference, which improve robustness to realistic distortions in face recognition and person re-identification and 2) new datasets for long-distance recognition. We propose a method that progressively learns from images prone to soft and strong distortions caused mainly by atmospheric turbulence. The method has a novel distortion loss to improve robustness, which is empirically shown to be highly effective in low-quality scenarios. Two further strategies are proposed to integrate distortion augmentation while also retaining the highest performance in high-quality scenarios. First, during training, an adaptive weighting schedule, which leverages the construction of different levels of distortion augmentation, is used to train the model in an easy-to-hard manner. The second, at inference, is a magnitude-weighted fusion of features from the parallel models used to retain the highest robustness across both high-quality and low-quality imagery. Different from prior work, our model does not leverage any image restoration or style transfer technique, and we are the first to employ explicit distortion weighting during training and evaluation. Our model achieves the best performances compared to prior works on face recognition and person re-identification benchmarks, including IARPA Janus Benchmark-S (IJB-S), TinyFace, DeepChange, Multi-Scene Multi-Time 2017 (MSMT17), and our novel long-distance datasets.
引用
收藏
页码:55784 / 55799
页数:16
相关论文
共 90 条
  • [51] AgeDB: the first manually collected, in-the-wild age database
    Moschoglou, Stylianos
    Papaioannou, Athanasios
    Sagonas, Christos
    Deng, Jiankang
    Kotsia, Irene
    Zafeiriou, Stefanos
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1997 - 2005
  • [52] Resolution based Feature Distillation for Cross Resolution Person Re-Identification
    Munir, Asad
    Lyu, Chengjin
    Goossens, Bart
    Philips, Wilfried
    Micheloni, Christian
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, : 281 - 289
  • [53] Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification
    Rao, Yongming
    Chen, Guangyi
    Lu, Jiwen
    Zhou, Jie
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 1005 - 1014
  • [54] On the Effect of Atmospheric Turbulence in the Feature Space of Deep Face Recognition
    Robbins, Wes
    Boult, Terrance
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 1617 - 1625
  • [55] Sengupta S, 2016, IEEE WINT CONF APPL
  • [56] Mining Hard Samples Globally and Efficiently for Person Reidentification
    Sheng, Hao
    Zheng, Yanwei
    Ke, Wei
    Yu, Dongxiao
    Cheng, Xiuzhen
    Lyu, Weifeng
    Xiong, Zhang
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) : 9611 - 9622
  • [57] Towards Universal Representation Learning for Deep Face Recognition
    Shi, Yichun
    Yu, Xiang
    Sohn, Kihyuk
    Chandraker, Manmohan
    Jain, Anil K.
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6816 - 6825
  • [58] Probabilistic Face Embeddings
    Shi, Yichun
    Jain, Anil K.
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6901 - 6910
  • [59] Shizhen Zhao, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12351), P647, DOI 10.1007/978-3-030-58539-6_39
  • [60] Body Part-Based Representation Learning for Occluded Person Re-Identification
    Somers, Vladimir
    De Vleeschouwer, Christophe
    Alahi, Alexandre
    [J]. 2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 1613 - 1623