FaceQgen: Semi-Supervised Deep Learning for Face Image Quality Assessment

被引:4
|
作者
Hernandez-Ortega, Javier [1 ]
Fierrez, Julian [1 ]
Serna, Ignacio [1 ]
Morales, Aythami [1 ]
机构
[1] Univ Autonoma Madrid, Sch Engn, Madrid, Spain
来源
2021 16TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2021) | 2021年
基金
欧盟地平线“2020”;
关键词
D O I
10.1109/FG52635.2021.9667060
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we develop FaceQgen(1), a No-Reference Quality Assessment approach for face images based on a Generative Adversarial Network that generates a scalar quality measure related with the face recognition accuracy. FaceQgen does not require labelled quality measures for training. It is trained from scratch using the SCface database. FaceQgen applies image restoration to a face image of unknown quality, transforming it into a canonical high quality image, i.e., frontal pose, homogeneous background, etc. The quality estimation is built as the similarity between the original and the restored images, since low quality images experience bigger changes due to restoration. We compare three different numerical quality measures: a) the MSE between the original and the restored images, b) their SSIM, and c) the output score of the Discriminator of the GAN. The results demonstrate that FaceQgen's quality measures are good estimators of face recognition accuracy. Our experiments include a comparison with other quality assessment methods designed for faces and for general images, in order to position FaceQgen in the state of the art. This comparison shows that, even though FaceQgen does not surpass the best existing face quality assessment methods in terms of face recognition accuracy prediction, it achieves good enough results to demonstrate the potential of semi-supervised learning approaches for quality estimation (in particular, data-driven learning based on a single high quality image per subject), having the capacity to improve its performance in the future with adequate refinement of the model and the significant advantage over competing methods of not needing quality labels for its development. This makes FaceQgen flexible and scalable without expensive data curation.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Blind image quality assessment with semi-supervised learning
    Li, Xiwen
    Wang, Zhihua
    Xu, Binwei
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 100
  • [2] Image Quality Assessment using Semi-Supervised Representation Learning
    Prabhakaran, Vishnu
    Swamy, Gokul
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW), 2023, : 538 - 547
  • [3] Semi-supervised deep learning for hyperspectral image classification
    Kang, Xudong
    Zhuo, Binbin
    Duan, Puhong
    REMOTE SENSING LETTERS, 2019, 10 (04) : 353 - 362
  • [4] Semi-Supervised Image Registration using Deep Learning
    Sedghi, Alireza
    Luo, Jie
    Mehrtash, Alireza
    Pieper, Steve
    Tempany, Clare M.
    Kapur, Tina
    Mousavi, Parvin
    Wells, William M., III
    MEDICAL IMAGING 2019: IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, 2019, 10951
  • [5] Deep Tone-Mapping Operator Using Image Quality Assessment Inspired Semi-Supervised Learning
    Guo, Cheng
    Jiang, Xiuhua
    IEEE ACCESS, 2021, 9 : 73873 - 73889
  • [6] No-Reference Image Quality Assessment Algorithm Based on Semi-Supervised Learning
    Jin Xiangdong
    Sang, Qingbing
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (04)
  • [7] Deep Semi-Supervised Learning
    Hailat, Zeyad
    Komarichev, Artem
    Chen, Xue-Wen
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 2154 - 2159
  • [8] SESQA: SEMI-SUPERVISED LEARNING FOR SPEECH QUALITY ASSESSMENT
    Serra, Joan
    Pons, Jordi
    Pascual, Santiago
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 381 - 385
  • [9] Deep semi-supervised learning for medical image segmentation: A review
    Han, Kai
    Sheng, Victor S.
    Song, Yuqing
    Liu, Yi
    Qiu, Chengjian
    Ma, Siqi
    Liu, Zhe
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 245
  • [10] A semi-supervised deep learning approach for cropped image detection
    Hussain, Israr
    Tan, Shunquan
    Huang, Jiwu
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 243