Thermal to Visible Facial Image Translation Using Generative Adversarial Networks

被引:47
作者
Wang, Zhongling [1 ]
Chen, Zhenzhong [1 ,2 ]
Wu, Feng [3 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Hubei, Peoples R China
[2] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430072, Hubei, Peoples R China
[3] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230027, Anhui, Peoples R China
基金
国家重点研发计划;
关键词
Face; generative adversarial network (GAN); image translation; infrared; thermal; LANDMARKS;
D O I
10.1109/LSP.2018.2845692
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Thermal cameras can capture images invariant to illumination conditions. However, thermal facial images are difficult to be recognized by human examiners. In this letter, an end-to-end framework, which consists of a generative network and a detector network, is proposed to translate thermal facial images into visible ones. The generative network aims at generating visible images given the thermal ones. The detector can locate important facial landmarks on visible faces and help the generative network to generate more realistic images that are easier to be recognized. As demonstrated in the experiments, the faces generated by our method have good visual quality and maintain identity preserving features.
引用
收藏
页码:1161 / 1165
页数:5
相关论文
共 50 条
  • [1] ClawGAN: Claw connection-based generative adversarial networks for facial image translation in thermal to RGB visible light
    Luo, Yi
    Pi, Dechang
    Pan, Yue
    Xie, Lingqiang
    Yu, Wen
    Liu, Yufei
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 191
  • [2] Impact of Image Translation using Generative Adversarial Networks for Smoke Detection
    Bankar, Atharva
    Shinde, Rishabh
    Bhingarkar, Sukhada
    2021 INTERNATIONAL CONFERENCE ON COMPUTATIONAL PERFORMANCE EVALUATION (COMPE-2021), 2021, : 246 - 255
  • [3] Image-to-Image Translation for Improvement of Synthetic Thermal Infrared Training Data Using Generative Adversarial Networks
    Hamrell, Hanna H.
    Karlholm, Jorgen M.
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING IN DEFENSE APPLICATIONS III, 2021, 11870
  • [4] Facial Image Translation in Short-Wavelength Infrared and Visible Light Based on Generative Adversarial Network
    Hu Linmiao
    Zhang Yong
    ACTA OPTICA SINICA, 2020, 40 (05)
  • [5] Image Translation with Attention Mechanism based on Generative Adversarial Networks
    Lu, Yu
    Liu, Ju
    Zhao, Xueyin
    Liu, Xiaoxi
    Chen, Weiqiang
    Gao, Xuesong
    IEEE INFOCOM 2020 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2020, : 364 - 369
  • [6] A Survey of Image Translation Based on Conditional Generative Adversarial Networks
    Tu H.
    Wang W.
    Chen J.
    Li G.
    Wu F.
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2024, 36 (01): : 14 - 32
  • [7] MWIRGAN: Unsupervised Visible-to-MWIR Image Translation with Generative Adversarial Network
    Uddin, Mohammad Shahab
    Kwan, Chiman
    Li, Jiang
    ELECTRONICS, 2023, 12 (04)
  • [8] Frequency-Aware Axial-ShiftedNet in Generative Adversarial Networks for Visible-to-Infrared Image Translation
    Lin, Hsi-Ju
    Cheng, Wei-Yuan
    Chen, Duan-Yu
    IEEE ACCESS, 2024, 12 : 151432 - 151443
  • [9] PCSGAN: Perceptual cyclic-synthesized generative adversarial networks for thermal and NIR to visible image transformation
    Babu, Kancharagunta Kishan
    Dubey, Shiv Ram
    NEUROCOMPUTING, 2020, 413 : 41 - 50
  • [10] Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation
    Darbaghshahi, Faramarz Naderi
    Mohammadi, Mohammad Reza
    Soryani, Mohsen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60