DDAT: Dual domain adaptive translation for low-resolution face verification in the wild

被引:10
作者
Jiao, Qianfen [1 ]
Li, Rui [1 ]
Cao, Wenming [1 ]
Zhong, Jian [1 ]
Wu, Si [2 ]
Wong, Hau-San [1 ]
机构
[1] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Guangdong, Peoples R China
关键词
Low-resolution face verification; Domain adaptation; Image translation; GAN; SUPERRESOLUTION; RECOGNITION;
D O I
10.1016/j.patcog.2021.108107
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Low-resolution (LR) face verification has received much attention because of its wide applicability in real scenarios, especially in long-distance surveillance. However, the poor quality and scarcity of training data make the accuracy far from satisfactory. In this paper, we propose an end-to-end LR face translation and verification framework to improve the generation quality of face images and face verification accuracy simultaneously. We design a dual domain adaptive structure to generate high-quality images. On one hand, the structure can reduce the domain gap between training data and test data. On the other hand, the structure preserves identity consistency and low-level attributes. Meanwhile, in order to make the whole model more robust, we treat the generated images of the target domain as an extension of the training data. We conduct extensive comparative experiments on multiple benchmark data sets. Experimental results verify that our method achieves improved results in high-quality face generation and LR face verification. In particular, our model DDAT reduces FID to 18.63 and 39.55 on the source and the target domain from 254.7 and 206.19 of the up-sampling results, respectively. Our method outperforms competing approaches by more than 10 percentage points in terms of face verification accuracy on multiple surveillance benchmarks. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:14
相关论文
共 62 条
  • [1] SSR2: Sparse signal recovery for single-image super-resolution on faces with extreme low resolutions
    Abiantun, Ramzi
    Juefei-Xu, Felix
    Prabhu, Utsav
    Savvides, Marios
    [J]. PATTERN RECOGNITION, 2019, 90 : 308 - 324
  • [2] Face description with local binary patterns:: Application to face recognition
    Ahonen, Timo
    Hadid, Abdenour
    Pietikainen, Matti
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) : 2037 - 2041
  • [3] [Anonymous], 2018, EUR C COMP VIS ECCV
  • [4] [Anonymous], 2016, NAT METHODS, DOI DOI 10.1038/nmeth.3707
  • [5] [Anonymous], 2008, 2008 IEEE C COMP VIS
  • [6] Finding Tiny Faces in the Wild with Generative Adversarial Network
    Bai, Yancheng
    Zhang, Yongqiang
    Ding, Mingli
    Ghanem, Bernard
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 21 - 30
  • [7] Multidimensional Scaling for Matching Low-Resolution Face Images
    Biswas, Soma
    Bowyer, Kevin W.
    Flynn, Patrick J.
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (10) : 2019 - 2030
  • [8] VGGFace2: A dataset for recognising faces across pose and age
    Cao, Qiong
    Shen, Li
    Xie, Weidi
    Parkhi, Omkar M.
    Zisserman, Andrew
    [J]. PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 67 - 74
  • [9] Recovering variations in facial albedo from low resolution images
    Chen, Xu
    Zhang, Zhihong
    Wang, Beizhan
    Hu, Guosheng
    Hancock, Edwin R.
    [J]. PATTERN RECOGNITION, 2018, 74 : 373 - 384
  • [10] Chen ZH, 2018, ADV CIV ENG, V2018, DOI [10.1109/EMBC.2018.8513089, 10.1155/2018/4064362]