Thermal to Visible Facial Image Translation Using Generative Adversarial Networks

被引:47
作者
Wang, Zhongling [1 ]
Chen, Zhenzhong [1 ,2 ]
Wu, Feng [3 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Hubei, Peoples R China
[2] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430072, Hubei, Peoples R China
[3] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230027, Anhui, Peoples R China
基金
国家重点研发计划;
关键词
Face; generative adversarial network (GAN); image translation; infrared; thermal; LANDMARKS;
D O I
10.1109/LSP.2018.2845692
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Thermal cameras can capture images invariant to illumination conditions. However, thermal facial images are difficult to be recognized by human examiners. In this letter, an end-to-end framework, which consists of a generative network and a detector network, is proposed to translate thermal facial images into visible ones. The generative network aims at generating visible images given the thermal ones. The detector can locate important facial landmarks on visible faces and help the generative network to generate more realistic images that are easier to be recognized. As demonstrated in the experiments, the faces generated by our method have good visual quality and maintain identity preserving features.
引用
收藏
页码:1161 / 1165
页数:5
相关论文
共 50 条
  • [21] Generative adversarial networks- and ResNets-based framework for image translation with super-resolution
    Hu, Hui
    Cui, Miao
    Hu, WenWen
    JOURNAL OF ELECTRONIC IMAGING, 2018, 27 (06)
  • [22] Colorization of Thermal Facial Images into Visible Facial Image Using RGB-GAN
    Bhadane, Dnyaneshwar
    Chakraborty, Soumendu
    COMPUTER VISION AND IMAGE PROCESSING, CVIP 2023, PT III, 2024, 2011 : 114 - 127
  • [23] SAR-to-optical image translation by a variational generative adversarial network
    Zhao, Jiaqi
    Ni, Wenxin
    Zhou, Yong
    Chen, Ying
    Yang, Zhi
    Bian, Fuqiang
    REMOTE SENSING LETTERS, 2022, 13 (07) : 672 - 682
  • [24] Visible and infrared image matching method based on generative adversarial model
    Chen T.
    Guo J.-F.
    Han X.-Z.
    Xie X.-L.
    Xi J.-X.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (01): : 63 - 74
  • [25] Single Image Cloud Removal Using U-Net and Generative Adversarial Networks
    Zheng, Jiahao
    Liu, Xiao-Yang
    Wang, Xiaodong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (08): : 6371 - 6385
  • [26] Unsupervised image translation using adversarial networks for improved plant disease recognition
    Nazki, Haseeb
    Yoon, Sook
    Fuentes, Alvaro
    Park, Dong Sun
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 168
  • [27] PolSAR Band-to-Band Image Translation Using Conditional Adversarial Networks
    Patel, Anery
    Patel, Maitreya
    Gadhiya, Tushar
    Roy, Anil K.
    2019 IEEE SENSORS, 2019,
  • [28] Semisupervised Hyperspectral Image Classification Based on Generative Adversarial Networks
    Zhan, Ying
    Hu, Dan
    Wang, Yuntao
    Yu, Xianchuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (02) : 212 - 216
  • [29] Rectified Wasserstein Generative Adversarial Networks for Perceptual Image Restoration
    Ma, Haichuan
    Liu, Dong
    Wu, Feng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3648 - 3663
  • [30] Histopathological Image Synthesis with Generative Adversarial Networks for Nuclei Segmentation
    Gour M.
    Rajpoot R.
    Jain S.
    SN Computer Science, 5 (1)